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This guidebook presents a process to elicit and 
organize information about school district practices, proposes 
standards to ^udg^ the effectiveness of those practices, and provides 
a method for determining desired improvements. Following the 
introduction, section 2 contains a distillation of the research 
findings on school effectiveness along with a discussion of how 
district practices influence a school's ability to promote student 
achievement. Section 3 presents the areas covered in the audit and 
suggests standards for assessing district effectiveness. Sections 4 
and 5 describe a step-by-step approach to conducting the audit. 
Included in section 6 are procedures for analyzing and interpreting 
information and recommendations for preparing and disseminating the 
report. Section 7 makes suggestions for planning district 
improvement. Section 8 consists of instruments to be used in the 
audit process — the interview guide and the questionnaire — while 
section 9 contains the forms to be used in analyzing the audit 
information and preparing the report. Appendices contain a 23-item 
bibliography along with names of board 'mbers and educators who 
collaborated in designing the audit. (MLF) 
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FOREWORD 



The District Effectiveness Audit grew out of the New Jersey School Boards Association's 
commitment to help school districts turn the research findings on effective schools into prac- 
tice. It is the result of a close collaboration with Research for Better Schools, Inc. and a number 
of board members and educators (named in Appendixes B and C). The time and energy they 
devoted to this project is deeply appreciated. 

We are also grateful to Joan Abrams and Betty Ste^fy and the members of the boards of 
education of Red Bank Borough and Moorestown Township who offered their districts as the 
initial field test sites for the audit. And we extend ihank yous to David Squires and Evelyn 
Ogden who handled the arrangements in those districts. 

The legislation that created the New Jersey School Boards Association charged it to **aid 
all efforts to improve public education in New Jersey." We believe the District Effectiveness 
Audit is an important step in fulfilling that mission. 




NJSBA Executive Director 
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INTRODUCTION 



This guidebook contains all of the informatioi: and materials a school district needs 
to assess its capability to improve and support the effectiveness of its schools. It presents 
a process to elicit and organize information about distria practices, proposes standards 
to judge the effectiveness of those practices, and provides a method for determining desired 
improvements. 

This audit is designed to be used by boards of education and district administrators 
to determine how their actions influence student achievement in their district's schools. 
It was developed in response to an often-repeated question asked by board members and 
district administrators about the effective schools research. '*It is fine," they s'^id, **to 
know what factors make a school effective. But what does a district do to help create those 
conditions? That's the information I need to do my job right." 

Providing an answer is not easy. While there is no shortage of books, papers and ar- 
ticles on the qualities of effective schools, only scant information exists on how district 
activities foster those qualities. Consequently, in addition to reviewing what had already 
been written on the topic, the originators of this guidebook convened two panels of ex- 
perts. The first, the Task Force on District Effectiveness (see Appendix B), sifted through 
research findings on effective schools and organizational effectiveness in the private sec- 
tor and, by inte^'ence, developed a list of factors to use in judging district effectiveness. 
This list was modified and validated by a second panel through a Delphi survey (see Ap- 
pendix C). In addition, the authors sifted through the research literature for conclusions 
or inferences about district influences on school effectiveness. These findings were reviewed 
by the panels and their consensus eventually became the standards found in this guide. 

Once the standards were identified, there arose a second question: How could board 
members and administrators find out if their districts met the standards? In seeking an 
answer, the idea of an audit was born. Like a financial audit, the District Effectiveness 
Audit Involves a close examination of certain practices, but it focuses on management 
rather than finance. 

The core of the audit is a series of interviews and the administration of a question- 
naire. The data thus gathered are analyzed and a report is generated. The following sec- 
tions explain in general and then in detail how the audit is conducted. 

Two New Jersey school districts. Red Bank Borcugh and Mc>orestown Township, 
volunteered to be the initial test sites for the audit. In each district, the authors plus a 



central office administrator served as the audit team. In Red Bank, which has two elementary 
schools, the authors conducted 19 interviews with board members, central office ad- 
ministrators, school administrators and selected teaching staff over a two-day period. The 
questionnaires were administered by a central office administrator to all teachers during 
40-minute staff meetings. Moorestown's larger size (three elementary schools, a middle 
school and a high school) necessitated three days of inter\'iewing with 34 board member^ 
and district and school administrators. Again, teachers filled out questionnaires during 
staff meetings. 

These field tests were invaluable in refining the audit materials and procedures. Substan- 
tive changes were made as a result. The testing is continuing, however, and all users are 
invited— indeed, urged— to share their experiences with the authors. Send all comments 
to the New Jersey School Boards Association, 413 W. State Street, P.O. Box 909, Tren- 
ton, NJ 08605-0909. 



Overview of the Audit Process 

Anyone can initiate the audit. All it takes is an interest in improving a district's capability 
to support stuoent achievement and a willingness to propose an audit to the district's board 
of education and chief school administrator. Once their commitment is secured, the audit 
process is underway. 

The next step is the formation of an audit team. This team is made np of five to seven 
key people in the district— for example, two representatives of the central office, c^e or 
two principals, a couple of teachers, and one or two board members. If the district chooses 
to employ an external consultant to help conduct the audit, that person might also be a 
member of the audit team. The team is responsible for either conducting the audit or for 
overseeing the work of the consultant. 

The audit is composed of two parts: a staff questionnaire and interviews with key 
people in the district. The questionnaire ic distributed as widely as possible to those who 
are knowledgeable about district practices. Interviews are held with those who are respon- 
sible for developing and implementing policy. Evidence to support opinions is sought in 
the interviews and, where possible, checked against supporting documents. Some districts 
may wish to add a third component to the audit by reviewing budget and time allocations 
in terms of district goals. 

After all of the information is gathered and compiled, the audit team or the consul- 
tant prepares a report comparing the district's practices against the audn standards and 
makes a presentation to the board of education. The report identifies strengths that the 
district should maintain as well as areas needing change or improvement. The completion 
of this report marks the end of the audit team's work and the beginning of active involve- 
ment by the board and administration. 

The board's responsibility is to review the data and set goals, establish priorities, and 
develop improvement plans based on the findings of the audit. The distnci's administrative 
team plays a key role in this Process by presenting the board with its recommendations. 
Other staff members, parents, and the community at large may also be involved in the 
district's improvement efforts. At the very least, they should be kept informed of the audit's 
progress, its findings, and the resulting plans. 
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fVhat the Audit Achieves 



When the audit is completed, district leaders have up-to-date information to help them 
establish district improvement goals in seven areas: 

1. setting goals and standards, 

2. defming and managing curriculum and program, 

3. assuring quality, 

4. allocating fiscal and human resources, 

5. creating a positive climate, 

6. making improvements, and 

7. working with the community. 

The district's practices in each area have been judged against specific practices shown 
to be supportive of school effectiveness. As a result, district leaders know more about 
their district's strengths and where improvement might be desired. 

A successful audit leads to a regular program of review and assessment and ongoing 
re-creation of improvement goals and plans. Where such programs already exist, the audit 
provides another means for assessing the needs of the district— needs that may be dif- 
ficult to uncover through other mechanisms, it should be noted, however, that the audit 
provides only a framework for analyses. It is not a formula for action. How the standards 
apply to specific situations and the beet means to realize them are f^ecisions to be made 
by those familiar with the local context. History, political environment and the availability 
of resources will shape interprerations of the audit. Ultimately, it is up to local decision 
makers to determirie the meaning of the audit results and what actions, if any, should 
be taken. 

A less tangible but equally important outcome of the audit is an increased sense of 
commitment to imp'-ovement v/ithin the district. Information is sought from a number 
of sources, creating a cadre of people interested in the outcome of the process. If ^hese 
people are provided with the results of the audit and involved in determining follow-up 
actions, they are highly likely to be committed to the improvements sought. 



fVhat the Audit Does Not Do 

The audit is narrowly focused. Ii looks only at the functions of the board of education 
and the district administration and, within that framework, deals solely vith those aspects 
that are linked directly to instructional effectiveness. It does not, for example, examine 
the district's collective bargaining practices. Their exclusion, however, does not not mean 
they are any less critical to the functioning of the district. Nor does it presume that they 
have no impact on student achievement. Rather, it indicates that too little study has been 
done in those areas to include them in this process. 

If the audit is to result in valid information for making improvement decisions, it 
must be implemented in a non-threatening way. The audit is not designed to evaluate 
individuals— staff or board members— and should not be used to do so. Its purpose is 
to gain information on district practices and any attempt to use it to assess the job perfor- 
mance of people will probably have disastrous results. Similarly, should school staff perceive 
the audit as an evaluation of themselves, the data obtained may be tainted and any deci- 
sions based on the information may cause more harm than good. Strange as it may seem, 



the best time to assess a district's effectiveness is when it believes it is doing a good job. 
People are always more open to change when they think they are building on strengths 
instead of correcting weaknesses. But even under less positive conditions, the audit must 
be conducted in a manner that seeks to identify and solve problems rather than find 
scapegoats. 



Structure and Contents of Guidebook 

In Section ^1, you will find a distillation of the findings of the research on school effec* 
tiveness along with a discus: ion of how district practices influence a school's ability to 
promote student achievement. Section III presents the areas covered in the audit and sug- 
gests standards for assessing district effectiveness. At that point, the guidebook becomes 
a how-to manual. Sections IV and V describe a step-by-step approach to conducting the 
audit. They explain how to get started with the audit, who should be informed, who should 
be involved, and what to include in a plan of action. They go on to describe how to obtain 
information from interviews and questionnaires, and how to use the instruments contain- 
ed in Section VIII. Included in Section VI are procedures for analyzing and interpreting 
information and recommendations for preparing and disseminating the report. Section 
VII makes suggestions for planning district improvement. 

Section VIII consists of instruments to be used in the audit process — the interview 
guide and the questionnaire— while the fmal section. Section IX, contains the forms to 
be used in analyzing the audit information and preparing the report. Appendix A is a 
bibliography of research on school and organizatirnal effectiveness and school 
improvement. 
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• II. 

RESEARCH SUMMARY 



Research has demonstrated that some schools provide more effective instruction to 
their students than other schools serving similar populations. This research, based largely 
on studies of elementary schools, has spawned both new theory in education and a move- 
ment seeking school improvement and greater equity in educational attainment. The most 
popular statement of this research, the so-called Five Factor Theory, identifies strong 
building leadership, clear goals, an orderly school climate, high expectations and stan- 
dards, and frequent monitoring ajid assessment of student progress as the essential character- 
istics of effective schools (Edmonds, 1979). Effective schools are der.cribed as being dif- 
ferent from schools in general. They are more tightly managed. Their curriculum, instruc- 
tional practices, and tests are more carefully aligned, and their work is directed toward 
agreed-upon goals. Such schools, researchers contend, are able to reduce the effects of 
socio-economic background on academic achievement. They are ''strong" schools that 
have policies and practices which reduce the influ'jnce of social environment and peer culture 
on student behavior and academic performance. Consequently, they are able to make greater 
demands on their students. Studies of these schools suggest that the processes of school- 
ing and the social environment of schools account for a significant portion of the varia- 
tion in achievement among schools. Comprehensive reviews of this research have been 
conducted by Purkey and Smith (1983), MacKenzie (1983), Rutter (1983), and Corcoran 
and Hansen (1983). 

The research on effective schools has been criticized for methodological weaknesses 
(MacKenzie, 1983; Rowan, Bossert, and Dwyer, 1983). It is important to remember that 
most of the studies have focused on urban elementary schools serving low-income children, 
and that the 'Tmdings" are merely correlations between school characteristics and stu- 
dent performance on basic skills tests. Yet, dozens of independent studies have produced 
similar findings. These findings are consistent with results of studies of effective teaching. 
There are also striking parallels between these findings and analyses of conditions in highly 
successful businesses (Clark, Lotto, and Astuto, 1984). Moreover, much of the research 
on implementation, school improvement, and workplace reform has reached conclusions 
similar to those drawn from the school effectiveness studies. Finally, the findings make 
common sense to practitioners, who accept them (Corcoran, 1985). In sum, there are power- 
ful and persuasive arguments for using the research on effective schools and classrooms 
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as the basis for assessing schools and school districts and for designing school improve- 
ment programs. 

For the purposes of this discussiop, theusynthesis prei5ared by Steward C. Purkey and 
Marshall S. Smith (1983) will be used as the **state of the art" summary of knowledge 
about effective schools. Purkey and Smith are critical of the studies but, at the same time, 
optimistic about their utility in school improvement programs. Their summary is presented 
in Figure 1. 



Organizational Structure Varieties 

1. School-site management. **...the leadership and staff of the school need considerable autonomy 
in determining the exact means by which they address the problem of increasing academic per- 
formance.** 

2. Instructional leadership. leadership is necessary to initiate and maintain the improvement 
process.** 

3. Staff stability. !n a successful school, further success is promoted if the staff remains together. 

4. Curriculum articulation and organization. **...a planned, purposeful program of courses seems 
to be academically more beneficial than an approach that offers many electives and few re- 
quirements.** 

5. School wide staff development. **.. .staff development should be schoolwide rather than specific 
to individual teachers and should be closely related to the instructional program. . . ' * Long-term 
support and reinforcement are required. 

6. Parental in> -^Ivement and support. parents need to be informed of school goals and student 
responsibilities, especially with regard to homework.** 

7. Schoolwide recognition of academic success. When schools publicly honor academic achieve- 
ment, students are encouraged to adopt similar norms and values. 

8. Maximized learning time. Schools emphasizing academics devote a greater portion of the day 
to academics, with more active learning and fewer interruptions. 

9. District support. Few significant changes can be realized without district support. Guiding and 
helping is probably the best role for the district office 

Process Variables 

1. Collaborative planning and collegial relationships. **. ..change attempts are more successful when 
teachers and administrators work together.'* Collegiality breaks down barriers, encourages shar- 
ing, and promotes unity and commonality among the staff. 

2. Sense of community. The feeling of being a part of a supportive community contributes to reduced 
alienation and increased achievement. Schools can create a sense of community through use 
of ceremony, symbols, and rules. 

3. Clear goals and high expectations. Schools need to focus on goals they deem most important 
and continually monitor pupil and classroom progress toward those goals. High expectations 
for work and achievement also characterize successful schools. 

4. Order and discipline. An environment which is quiet, safe, and non-distracting promotes learn- 
ing, clear, reasonable rules, fairly and consistently enforced, ...reduce behavior problems.., and 
promote pride and responsibility in the school community.** 



"Adapted from Purkey, 5., and Smith, M. S., 1983, Effective Schools: A Review, The Elementary School 
Journal 83 (4), 1983, 427-452, 



Figure 1: 

Dimensions of Effective Schooling* 




Implications fo^ District Policy and Practice 



Research on the characteristics of effective teaching and effective ?^chools is considerably 
more extensive than studies of school board performance and school district operations. 
Yet, leadership and support from local educational leaders and central office personnel 
are crucial to stimulating and sustaining school and classroom improvement. This conclu- 
sion comes from studies of school improvement (German, 1984; Crandall, Loucks, & Eisen- 
man, 1983; Louis, Rosenblum, & Molitor, 1981) and from experience in working with 
schools. It is also drawn from a review of programs based on the effective schools research, 
most of which have been initiated by school district staff (Miles and Kaufman, 1985). Yet 
school effectiveness * 'theory" gives little consideration to the role of school districts. Many 
authors define the school as the unit of change and advocate a **grass-roots" school-by- 
school approach to improvement. This view is a logical derivative of the conclusion that 
school cultuic, which varies from school to school, is the dominant factor in determining 
effectiveness. School autonomy has been assumed in the research designs and then often 
championed in the conclusions. Districts are expected to play supportive roles, but the 
real action (and initiative) in the view of these authors and advocates rests, as it should, 
at the school level (Marsh and Berman, 1984). 

This perspective is simply out of touch with the realities of school governance and 
operations. The school may be the proper unit of analysis for change, but scliools are 
not independent of scnool systems. Schools function within a nested hierarchy of federal, 
state, and local policy. Operations of the local district, in particular, have a profound 
influence on school effectiveness and the possibilities for improveme:it. Furthermore, during 
the past three decades there has been a steady drift ^''authority from the school to the 
district as a result of collective bargaining and federal and state regulations (Talbert, 1981). 
It is probably more valid to think of schools as co-managed by district and building ad- 
ministrators, in spite of the fact that the balance of power and authority in this partner- 
ship varies enormously from district to district (Cuban, 1984; Yin, Blank, & White, 1984). 
The issue of school autonomy versus district control or initiative cannot be resolved in 
ihe abstract. It depends upon the local context and how local policy makers view the desired 
mix of central control and delegation. 

Even in situations in which some form of school-site management prevails, districts 
may exercise enormous influence on school and classroom effectiveness: 

• by determining the composition of the student body; 

• by defining the criter '\ for student success or failure with promotion standards, 
attendance requirements, and local graduation requirements; 

• b> determining t>^e quantity, quality, and fit of instructional materials; 

• through patterns of resource and time allocations; 

• by the degree of decentralization of derision making— districts vary in the amount 
o^ authority they give to principals and tl .e degree of latitude given teachers with 
curnculun: 

• through stfiff selection and assignments; 

• by setting the tone for the organization and shaping the expectations and work 
norms of their staffs; and 

• through collective bargaining and contract enforcement (Corcoran, 1985). 
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District policies and procedures also have been shown to have significant effects on 
the development and success of school improvement programs. For example: 

• districts are typically the initiators of broad-based improvement efforts; 

• districts often determine which schools f larticipatc. For example, David and Peter- 
son (1984) found that while the policy of the California School Improvement 
Program called f' r schools to volunteer, in practice districts selected the 
volunteers; 

• districts may determine the implementation strategy — whether it be top-down, 
bottom-up, or a combination of the two (Berman and McLaughlin, 1979; Smith 
and Purkey, 1985); 

• the attitudes of district leadership may influence school staffs' view of an im- 
provement effort as a fundamental change, a project, a source of funds, or more 
paperwork (Marsh & Berman, 1984; David & Peterson, 1984). Commitment on 
the part of leadership is critical to successful change (Fullan, 1982; Cuban, 1984); 

• districts provide resources. Almost all improvement programs involve costs, 
especially staff time, that require district approval (Cuban, 1984, Rowan, 1983); 

• districts are in the best position to provide schools with assistance because district 
staff are most familiar with individual schools and are able to spend time work- 
ing there (Crandall, Loucks and Eisenman, 1983). The districts are more likely 
to have a pool of people to play this role (David & Peterson, 1984); 

• districts can often provide important incentives and recognition for staff efforts 
and accomplishments (Smith and Purkey, 1985); and 

• districts may bt able to provide relief from policies, routines, or contractual 
provisos that limit or obstruct iuprovement efforts (Smith and Purkey, 1985). 

Even this brief review makes clear that district leadership — the board of education, 
the superintendent, and the central office staff — plays a critical role in shaping the out- 
comes of school improvement initiatives. They are in the best position to initiate action 
(or to obstruct it); they have the opportunity to plan and coordinate; thev control critical 
resources; and, ultimately, they decide whether the effort was a success or failure and if 
it should be expanded, continued, or put on the shelf with other well-intended plans. 



Applications of the School Effectiveness Research 

Districts all over the country have designed or adopted **et*ective schools" programs. 
Typically, these programs are intended to raise test scores and include elements such as: 

• deflnition of instructional goals; 

• new promotion and/or graduation requirements; 

• changes in time allocations for instruction; 

• mandated planning for each school; 

• alignment of the curriculum taught and texts and materials with the tests being 
administered; 

• revision of supervisory practices to align them with district goals; 
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• creation of a district assessment program to monitor student progress; and 

• staff development focusing on efl'ective schools and teaching, supervision, assess- 
ment, and planning (Cuban, 1984). 

The general intent of these programs is increased control over instruction and tighter 
coupling between the classroom and the district. This search for tighter coupling often 
results in improvement programs being designed by district staff and implemented in a 
top-down fashion. As one observer notes: 

From images popular in the academic journals of schools as loosely linked, amor- 
phous enterprises with plenty of slack, a counter image now emerges from such 
districts of organizations tightly coupled in both goals and formal structure, targeted 
sharply on academic productivity. District officials pursuing policies that fasten 
individual schools snugly to the central office believe they have found just the right 
hammer to pound in a nail (Cuban, p. 134). 

Considering the pressure on district leaders to raise test scores, such policies are 
understandable, particularly if they produce quick gains in achievement. But these gains 
may be short-lived and the unanticipated consequences costly. The top-down, tighter- 
coupling approach to effective schools may lead to increased bureaucratization and simp- 
ly a higher level of mediocrity. Increased uniformity combined with stricter control may 
lower the morale, level of effort, and professionalism of the teaching staff. Dependency 
on basic skills tests may narrow the curriculum and reduce time devoted to other impor- 
tant content. Stronger accountability measures without compensating discretion and par- 
ticipatioi; may increase conflict between teachers and administrators and lead to a ''work 
to rule" attitude. The press toward efficiency is not necessarily bad, it may even be essen- 
tial, but it is unlikely to be sufficient for creating conditions for long-term improvement 
in school effectiveness. 

Most analysts interpret the effective schools literature differently from the popular 
version described above. The central message, they would contend, is that good schools 
have a culture that promotes and supports goal consensus, cooperation, achievement orien- 
tation, problem solving, and high discretionary effort. In this view, people and the resources 
people bring to their jobs are a good school's major assets. Good schools and good managers 
create conditions under which people perform at their beat. 

In this view the role of the district is to encourage, nurture, and develop the desired 
work cultures in schools. This suggests an inversion of the conventional approach to im- 
plementation of improvements. Emphasis is placed on maximizing school level respon- 
sibility rather than gaining greater central control. School staff are asked to identify and 
clarify problem;, develop and implement plans, make decisions about assignment of 
resources, and plan staff development activities. 

The district's role is to provide direction and resources, including moral support, in- 
centives for participation, time, funds, and technical assistance. The district also sets the 
parameters within which school-based improvement occurs by setting overall goals, defming 
indicators of quality, reviewing plans, and monitoring implementation. District leaders 
are ultimately responsible for the outcomes and cannot abdicate that responsibility. They 
are the ones who have both the authority and the responsibility to create the school condi- 
tions under which optimal effectiveness is attained. The issue is how to best create those 
conditions. 
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What Should Districts Do? 



Faced with such conflicting advice about how to improve schools, what should district 
leadeis do? In the face of public demands for better student performance, choosing not 
to act at all no longer remains an option. The answer to the dilemma depend 'n part on 
local context and on the district and community. Beyond that, the research piuvides some 
guidelines for action. A review of the research suggests that there are nine key functions 
districts must perform if school impro\ement is to have any chance of success: 

1 . District leaders must determme what decisions and functions belong to central 
administration and what decisions and tasks can be properly carried out at the 
building level. This is what Peters and Waterman (1983), in their bestseller on 
successful corporations, refer to as simultaneous loose-tight properties. District 
leaders must determine what values are so important that they must be tightly 
monitored and controlled and which can be delegated or left to discretion at 
the building level. 

2. District leaders must set and communicate clear goals. They must ask what 
the system is about and what it should be about. Goals should be stated in 
a manner that permits verification of attainment. 

3. District leaders must address the question of what should be taught and set 
up a process for making such decisions. Whether curriculum is defmed cen- 
trally, in each school, or (in some cases) in the classroom, there must be a pro- 
cess ^o validate those decisions and ensure that they are actually put into practice. 

4. District leaders should define the indicators used to assess school quality and 
change. Developmg and managing this information system is probably a cen- 
tral office function. Information should include outcome data and indicators 
of those school conditions believed to be related to high performance. 

5. District leaders should develop policies that encourage staff to identify and 
solve problems, work cooperatively, and make the maximum effort to achieve 
goals. 

6. The district must develop policies and practices that foster a climate in which 
people can be productive, cooperative, and willing to face up to problems. Trust 
is essential if people are to accept responsibility for improvement. 

7. District leaders should foster policies that provide incenti' .or initiative and 
improvement. They should emphasize that improvement is a collective respon- 
sibility and hold themselves and central office staff accountable for carrying 
out their responsibilities. 

8. District leaders should ensure that the allocation of money, people, and time 
reflects district goals and priorities. The district must provide funds, technical 
assistance, and staff development to support improvements. They should also 
insure that their policies in selecting, assigning, and promoting staff are con- 
sistent with their goals. 

9. Finally, the district must take a long-term view of improvement by setting 
reasonable timelines and providing for continuity of development. 

These are the main messages that the research on school effectiveness and school im- 
provement has for school districts. Although they raise questions to which there are often 
no definitive answers, they still must be addressed. That is the purpose of this audit. 
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• in. 

AUDIT AREAS AND 
STANDARDS 



o 
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The District Effectiveness Audit is based on a set of standards for district policy and 
practice. These standards are grouped into seven areas: setting goals and standards, manag- 
ing curriculum and program, assuring quality, allocating resources, creating a positive work 
environment, making improvements, and working with the community. Each area con- 
tains two to four standards and each standard is followed by a set of indicators that fur- 
ther defme good policy and practice. The standards and indicators are presented in Figure 2. 



Setting Coals and Standards 

1 . Tht central mission of the school district is the provision of high quality instruction to all children. 

a. The district holds the same high academic standards for all its students. 

b . The provision of high quality instruction in the distrct is discussed at all board meetings. 

2. The school district has defmed a set of educational goals based on the district mission statemem 
that are specific enough to permit assessment of progress. 

a. The district has defmed measurable student outcomes related to its goals. 

b . The district has specific student promotion standards and requirements. 

c . The district's goals have been used to set individual school goals. 

Managing Curriculum and Program 

1. Decisions about the curriculum, including content, sequence, time allocations, and student ac- 
cess, are based on district goals. 

a . The district has clear curriculum guidelines that are used to define classroom instruction. 

b . The curriculum guides provide for sufficient flexibility (e.g., to meet unique student needs 
or to take advantage of unique staff skills and expertise). 

c . District policies ensure that student grouping for instruction meets the needs of all students. 

d . The district ensures that appropriate assistance is provided to students not meeting district 
academic and behavioral standards. 



Figure 2 
District Audit Standards 
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District Audit Standards (continued) 

2. The district has policies to ensure that curriculum and instruction are coordinated. 

a . There is a clearly defined process for the adoption of curricula that is followed by the 
board and district staff. 

b . There is a clearly defined process for the selection of textbooks that is followed by the 
board and district staff. 

c . Curriculum and instruction are coordinated across grade levels and schools. 

d . The district has policies to ensure that all special programs are coordinated with the regular 



3. The district seeks to focus staff and student time on .nstruction and learning. 

a . Central office staff are expected to spend a majority of their time monitoring and im- 
proving curriculum and instruction. 

b . Principals are expected to spend at least half of their time on monitoring and improving 
curriculum and instruction. 

c . The district emphasizes minimizing interruptions in instructional time. 

d . The district encourages staff to work with students in activities outside the school day 
that are linked to the curriculum. 

Assuring Quality 

1. Ihe district requires regular and frequent monitoring of student progress, 
a. The district requires frequent teacher assessment of student progress. 

b . District-wide assessment of student performance is conducted annually in an academic 
areas and at all grade levels. 

c. Tests used to assess progress are aligned with the curriculum. 

d . Student test results are provided to school staff in a timely and usable manner and are 
reviewed and discussed by staff. 

2. The effectiveness of the curriculum is regularly evaluated. 

a. Thorough curriculum review, K-12, is conducted on a regular schedule. 

b . The district has implemented procedures to monitor curriculum implementation. 

3. Supervision and staff evaluation are used as methods for improvement of instruction, 
a . Teaching staff evaluation is based on specific district-wide criteria. 

b . Supervisors are expected to provide feedback and assist ince to teaching staff. 

Allocating Resources 

1 . Fifcal resources are sufficient to support district goals, satisfy state and federal regulations, and 
foster growth and improvement. 

a . All district programs are adequately funded. 

b . At least 70^ of the district's budget is spent on instruction. 

c . District resources are perceived as being fairly distributed across the district. 

d . Resources for curriculum development are adequate and coordinated district-wide. 

2. The district's personnel policies are used to support school quality. 

a. All personnel openings are widely publicized. 

b. Personnel openings are filled only by the most qualified candidates 

c . Principals are responsible for recommending appointments to school staffs. 

d . The district manages the salary scale to attract and retain the most effective Instructional 
and administrative staff. 
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District Audit Standards {continued) 

e . Centnil office staff are actively involved in the ongoing supervision and development of 
school staff. 

3. District leaders allow school staffs as much discretion as possible in the allocation of fiscal and 
human resources within the framework of district priorities. 

a. Principals have fiexibility in preparing and controlling their school budgets. 

b. Principals involve staff in the development and review of school budgets. 

Creating a Positive Work Environment 

1 . The board and superintendent have agreed on the scope and direction of their mutual roles and 
responsibilities. 

a. The board and superintendent agree on their mutual roles and responsibilities. 

b . The board and superintendent are able to resolve administrative disagreements. 

c . The board holds the district superintendent accountable for implementing district pro- 
grams and policies. 

2. District policies promote success among the staff and students. 

a . In practices regarding class size, teacher assignments, and scheduling, district leaders give 
priority to teacher/student contact. 

b . The district has procedures for identifying and publicly recognizing high performance by staff. 

c . The district has procedures for identifying and publicly recognizing high perfoimance by 
students. 

3. District policies encourage and support staff input into district decision making and collegial 
relationships among staff. 

a. School staff participate in the development of district goals, programs and policies. 

b . District leaders encourage communication among school personnel by providing time for 
staff to get together professionally. 

4. The district's schools and offices are pleasant places for students and staff. 

a. Schools and offices are clean and well-maintained. 

b . Schools and offices provide adequate work space for staff ard students. 

c . Schools and offices are safe for both staff and students. 

iviaking Improvements 

1. District leadership demonstrates a commitment to improvement. 

a . District leaders express the theme of continuous improvement in district plans, activit.es, 
and publications. 

b . District leaders perceive the school as the unit of change and improvement. 

c . District leaders provide adequate timelines for school improvement. 

d . District leaders encourage staff to take calculated risks in school improvement efforts. 

e . District leaders stress research findings on effective school practices in their improvement 
efforts, 

2. The district has a long-range improvement plan that defines specific targets for student outcomes. 

a . District leaders hold school staffs responsible for school improvement plans aimed at im- 
proving student achievement. 

b . District leaders give principals authority to modify instructional policies and practices to 
address particular school deficiencies. 

c . District leaders recognize the professional expertise of teachers and administrators. 



19 



19 



District Audit Standards (continued) 

3. Board of education policies and regulations enhance the capacity for change and provide for 
related development programs. 

a . Professional development activities are related to district and building improvement 
priorities. 

b . District leaders provide adequate incentives for participating in professional development. 
fVorking with the Community 

1. The district maintains frequent and open communication with the community. 

a . The district requires principals and teachers to be accessible and responsive to parents. 

b . Student test results in all areas of the curriculum are made known to the publiv . 

c . The district provides opportunities for parents to become involved in the education of 
their children. 

d . Parents and community are involved in the development and evaluation of district goals, 
programs and policies. 

2. School facilities are available and used by the community. 

a . School facilities are widely used by the community during school and non-school hours. 

3. The district makes effective use of extcmaJ resources. 

a . The district has a plan for soliciting and using assistance from external agencies. 




• IV. 

PLANNING THE AUDIT 



This audit has been designed for districts of all sizes ar.d types. It can be conducted 
as a self-study or used by an external consultant brought in by the district. Since each 
district is unique, the following suggestions are general in nature and may need to be in- 
terpreted somewhat differently by each district. 



How to Get Started 



Communication is the key to a successful audit. The more people who know that the audit 
is taking place, why it is being conducted, and how the information will be used, the greater 
the likelihood of obtaining meaningful results. Therefore, a vital piece of the implemen- 
tation plan is deciding who to inform, when, anJ how. 

The communication process should begin with the board of education. One reason 
for this is that the audit must be conducted under us auspices. Another is that the board 
must agree to look at its own actions as part of the process. Still, a third and even more 
important reason for communicating with the board at the beginning of the audit is that 
the board must commit itself to using the information that the audit generates. If the board's 
enthusiasm is only half-hearted, the audit will be an exercise in futility at best and could 
damage staff morale and/or reduce public support. 

The board should be told why the audit is being proposed and how it will benefit the 
board and the district. It needs to know what the audit process entails and the rcle(s) board 
members will play in that process. The board must clearly understand that the audit is 
a tool for improvement planning, not a mechanism to **get" individuals, be they board 
members or staff. The board must also accept that the process requires time. The results 
will not appear overnight, nor \ /ill good data be generated, unless sufficient time is allocated 
by the staff and the boari to data collection and analysis. 

Another group critical to the audit's success is the district's administrative team. (The 
audit process assumes hat school principals are considered part of this team along with 
central office administrators.) A large portion of the audit focuses on the practices of these 
administrators. They are also one of the primary sources of information for the audit. 

Like boards of education, the administrative team must '^e fully Informed of the reasons 
for conducting the audit, how the data will be collected, and how the results will be used. 
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It is reasonahSe for some members of the team to feel uneasy about their activities being 
placed in the spotlight. If that concern is intense or widespread and efforts to ameliorate 
their fears unsuccessful, it is probably not an appropriate time to conduct the audit. 

Teachers and other staff members should also be made aware of the audit, but since 
their involvement in the process will be considerably less than that of the administrative 
team, their support is less critical. The same is true of the public. However, once the deci- 
sion to conduct the audit is made, every effort should be made to alert the staff and the 
community to what will be happening and why. 

Organizing the Team 

The audit team is the central organizing unit even in situations where an external consul- 
tant has been retained. In fact, the recommendation to bring in a consultant may come 
from this team. The team is responsible for developing the audit plan, monitoring and 
reporting on the progress of the audit, presenting the final results, and, where no consul- 
tant is retained, gathering and analyzing the information. 

The size of the team depends on the size of the district and the dif ilculty of collecting 
valid information. In a very small district, the team could consist of one central office 
administrator and one board member. A larger district might consider adding another ad- 
ministrator or two and representatives of che staff and community. A very large district 
could form a steering committee of 5 to 10 people and seek additional assistance from 
district staff. 

If the team is going to collect data itself, it is vital that team members be skilled at 
interviewing. Even though the audit interview is semi -structured with prepared questions 
and scoring keys, interviewers will often need to ask follow-up questions in order to get 
full information. Knowing how to probe for the right information is important. Inter- 
viewers also will take notes that illustrate district policies and practices. These notes will 
be a valuable resource in preparing the audit report. The ability to code what is actually 
said and not the interviewer's interpretation is also critical. Because of this, it is probably 
best to avoid putting anyone with a particular ax to grind on the team. 



Bringing in a Consultant 

The chances of getting accurate information increase with the use of a skilled external 
consultant. People generally feel free to speak more candidly to someone who has no per- 
sonal stake in what is said and who they think will maintain their confidentiality. Even 
where high trust exists, frankness is easier with someone v/ho is not a boss, subordinate, 
or colleague. 

Also, just as with financial audits, it is useful to have the organization's practices ex- 
amined by someone who is not afraid to point out deficiencies wherever they are found. 
Someone from outside the district can present information without any need for 
defensiveness. 

Another reason for bringing in a consultant is time. With the right consultant, the 
audit will probably be completed more rapidly because this person will have the skills to 
efficiently complete the interviews and analyze and interpret the data. While some board 
members and staff may have the same skills, asking them to add audit responsibilities 
to their already crowded schedules is bound to cause a delay somewhere along the line. 
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The benefits of having a consultant conduct the audit, however, depend upon the 
district's ability to find someone who is qualified at a price it can afford. One suggestion 
is to contact your state school boards association. That organization often can provide 
quality assistance at little or no cost. 



Fstahlishing the Audit Plan 

Once the audit team is organized, its first task is to develop an implementation plan. The 
plan will include a list of tasks to be performed, who will perform them, and the timelines 
within which they will be accomplished. The plan should answer to following questions: 

1. How will staff be informed about the project? 

2. How will the community be informed? Are there segments of the community 
that need more information than others? Who are the informal key com- 
municators in the community and iiuw will they be reached? 

3. Who will conduct the interviews? Is a consultant needed? Do district staff need 
preparation to conduct the audit? 

4. Who will be interviewed to get the necessary information? How many people 
will be intervjc'wed in order to obtain a valid cross-section of opinion? (The 
larger the district, the larger the sample required.) 

5. How will the questionnaire be administered and to whom will ic go? Will it 
be administered to all staff or to a sample? How will the sample be identified? 

6. \V'..o will aggregate and analyze the data? Will a computer tabulation of the 
questionnaire be used? (The answer will depend upon the number of responses 
anticipated.) 

7. Who will write the report? Team members should be in agreement on the report 
and any conclusions it presents. How will this be achieved? For instance, will 
the team meet to discuss the information before the report is written? Will the 
report be circulated in draft form to team members? 

8. How will the report be presented to the board of education, to the administrative 
team, to the staff, and to the public? 

9. What is the scnedule for beginning and completing each activity? (Each inter- 
view will take about an hour and a half. The questionnaire will take 30 minutes 
to complete.) 

10. How and to whom will progress be reported? 

When the answers to these and related questions have been formulated, the audit plan 
should be reviewed by the superintendent and the board of education. Then the implemen- 
tation process begins. 
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• V. 

CONDUCTING THE AUDIT 



Two parallel forms are used to collect information for the audit — an interview guide 
and a questionnaire. Both forms collect detailed information on the district's performance 
in terms of the standards set forth in Section III. 



Conducting the Interviews 



The interviews are the primary means for obtaining audit information. The people most 
appropriate for interviewing are board members and central office and school ad- 
ministrators. Some districts may include teaching staff in the group to be interviewed; 
others may, because of their size, interview only a sample of administrators and board 
members. In the latter case, caution should be exercised to ensure the sa.nple is both large 
and broad enough to ensure accurate data. 

Each interview takes approximately one and a half hours to complete. An interview 
guide containing 67 items is included in Section VIII. Each item consists of an open-ended 
question and a continuum of five descriptors. Each question, read verbatim by the inter- 
viewer, asks the respondent to describe district goals, policies, or practices in terms of 
the audit standards. After carefully listening to the respondent's answer, the interviewer 
categorizes the response on the continuum of descriptors. Clarifying or follow-up ques- 
tions may be necessary to categorize the response. The five descriptors represent the range 
of responses from worst to best practice, with typical district practice at the midpoint. 
Important details or examples reported by the respondent are also recorded on the inter- 
view form for later reference. 

In order to collect information that is as complete and accurate as possible, each in- 
terview should be carefully planned and skillfully conducted. Here are some tips that might 
be helpful. 

In setting up the interview, be sure the interviewee is aware of the time commitment 
involved. Also, be sure the person is familiar with the audit's purpose and procedures 
and understands the roles you (the interviewer) and he or she are to play in the process. 
Arrange, insofar as possible, to hold the interview in a comfortable place (preferably in 
the building where the person works) where you will not be interrupted and where you 
can enjoy a reasonable degree of privacy. 

The most successful interviews will be those where a climate of informality, trust, and 
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openness has been established. One way to achieve this is to start the interview with a 
quick review of the reasons for the interview and the kinds of questions you will be ask- 
ing. Stress the confidential nature of the interview and explain how the data are to be 
handled. Explain that you will be asking for illustrations of key points and that the notes 
you will be taking may be used in the audit report. Assure the person that it is understood 
that he or she may not be able to answer all the questions and that an "I don't know" 
is quite acceptable. It is also ir.portant to stress that the focus of the audit is on the district 
and not individual schools and that the interviewee should try to respond to the questions 
in terms of the district as a whole. The cover sheet for the interview guide contains a state- 
ment covering some of these points. You might want to read it aloud. 

As you conduct the interview, be aware that your body language and eye contact will 
influence the course of the interview as much as the questions you ask. If you sit leaning 
slightly forward and shift your gaze back and forth between the speaker and your notes, 
you will be conveying a sense of attentiveness and interest in the speaker. Allowing the 
speaker a few moments to reflect on the question you have asked before you interject 
anything further will also help create a comfortable climate. 

There will be times when you will want to probe for further information, get some 
specifics, or clarify an idea. "Why?" is the question most frequently used but others, such 
as "Would you explain further?" or "Can you expand upon that?", work equally well. 
Sometimes it may become necessary to ask a very pointed question in order to be able 
to code an item. Try to frame these in terms of an example, like "When such and such 
a situation arises, does the central office and board respond by...?" Try to avoid asking 
questions that point to a "right" answer, however. 

From time to time, try to crystallize what has been said by paraphrasing what you 
have heard. This is a good way to test whether you are correctly interpreting the content 
and tone of what has been said. It is also an effective method of refocusing the interview 
and moving on to the next question. 

Conclude the interview by asking whether there are any areas of the district's opera- 
tions that he or she feels have not been adequately addressed. If there are, note them on 
the interview form. Express gratitude for the time and thought he or she has put into the 
interview and take your leave. If necessary, rewrite your notes as soon as possible. 



Administering the Questionnaire 

The audit questionnaire contains 67 items that parallel the "best practice" descriptors from 
the interview questions. Respondents are asked to indicate on a five point scale the extent 
to which they believe the district follows each practice. The scale ranges from "Not at 
air* to "Completely". Approximately 30 minutes are needed to complete the questionnaire. 

The questionnaire is designed to be an adjunct to the interviews and not a replace- 
ment for them. Like the interview questions, the items are difficult, if not impossible, 
to answer by someone who is not thoroughly familiar with the operations of the district. 
Therefore, the most likely people to be asked to fill them out are teaching staff and any 
administrators who cannot be interviewed. 

If the audit team has decided to administer the questionnaire to all teaching staff, 
it is best to do so at school staff meetings. This will prevent discussion of the items in 
the faculty lounge and will aid in getting good data. If the district is large and the ques- 
tionnaire is to be administered to only a sample of staff, bringing everyone together becomes 
more of a problem, but still should be attempted. 
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VI. 

ANALYZING THE AUDIT 
DATA AND PREPARING 
THE REPORT 



Once the audit interviews and questionnaires have been completed, the responses must 
be aggregated, analyzed, and then organized into a report. This section describes step-by- 
step procedures for accomplishing all three tasks. Forms for completing these tasks are 
contained in Section IX. i<ead this section before you begin the analyses of the data. 



Aggregating the Audit Information 

All of the individual interview /questionnaire responses must first be transferred from the 
two sets of completed forms (interview and questionnaire) to the appropriate coding charts. 

Step 1 

Make two complete sets of the District Effectiveness Audit Analysis Form, one for the 
interview responses and one for the questionnaire responses. Although the inter /iew and 
questionnaire responses are coded using the same analysis forms, coding must be done 
separately for each set of responses. 
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Step 2 



Transfer all of the interview/questionnaire responses to the appropriate coding chart fo: 
each standard on the analysis forms. There is a separate coding chart for each standard. 
For each itern, enter the responses to Response Choice 1 under column 1 for that item, 
responses to Response Choice 2 under column 2 for that item, and so on. 



EXAMPLE 1. For item 1, the interview responses were the following: 



ResponM Choice 

1 
2 
3 
4 

5 



Number of Responses 

0 
0 
4 
3 
3 



To complete the coding chart for item 1 , the following entries should be made: 



Coding Chart 



Item 


Response Choice 
1 2 3 4 5 


N 


Item 
Mean 


1 


0 


0 


4 


3 


p 






Overall 
Standard 

















Step 3 

Once all of the responses for a single item have been coded, calculate, the total number 
(N) of responses to that item. Enter the total under column N. 



EXAMPLE 2. Usinr the same item responses for Example 1 , the following entry should 
be ...dde on the coding chart: 

Coding Chart 



Item 



Response Choice 
12 3 4 



10 



Item 
Mean 



2 



Overall 
Standard 
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After all of the interview/questionnaire responses have been entered on the coding chart, 
calculate the Overall Standard Totals for each of the Response Choices and N. 



EXAMPLE 3. Expanding on the previous example, the following entries might be made 
on the coding chart where there are two items for the standard: 

Coding Chart 



Item 


Response Choice 
1 2 3 4 5 


N 


Item 
Mean 


1 


0 


0 


4 


3 


3 


10 




2 


0 


1 


4 


3 


2 


10 




Overall 
Standard 


0 


1 


8 


6 


5 


20 





It should be emphasized that although the interview and questionnaire items are very 
similar, they should be aggregated and analyzed separately and only then compared. 



Analyzing the Audit Information 

Two sets of statistics (one for interview responses and one for questionnaire responses) 
must be computed for each of the 21 standards. First, item means are computed to deter- 
mine the district's performance in terms of that particular item, as assessed by the group 
of interview or questionnaire I'espondents. Second, standard means ^ computed from 
all of the interview or questionnaire items within each standard in order to obtain a broader 
measure of the district's performance.' 

If you have access to a computer that can compute simple descriptive statistics, the 
aggregation and analysis of responses will be fairly simpiv^; and quick. If you must com- 
plete these tasks by hand, instructions are provided below. As indicated earlier, forms 
for completing these tasks are contained in Section IX. 

Item Means. Item means are calculated separately for the interview and questionnaire 
responses. In order to calculate each set of 67 item means, you will need: (1) the coding 
charts reporting the item re ponse choices and N and (2) a blank mean chart. A sample 
blank mean chart is provided after each standard coding chart; you will have to make 
multiple copies to equal the total number of items for which you are computing item means. 



'5o/ne districts may want to examine the interview or questionnaire responses of not only the total group, 
but also sub-groups (e.g., board members, central office administrators, building by building staff). In these 
instances, item and scale means can be computed following the same procedures outlined in this section. 
However, each group *s responses must be coded separately. 
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Step 5 



For each item transfer the Item Response Choice Totals for each of the five response choices 
from the coding chart to the Item Total column on the item mean chart. 



EXAMPLE 4. Itom Respoi.«>e Choice Totals are transferred from the coding chart to 
the Item Total column on the item mean chart: 

Coding Chart 



Item 


Response Choice 
1 2 3 4 5 


N 


Item 
Mean 


1 


0 


0 


4 


3 


3 


10 




2 


0 


1 


4 


3 


2 


10 




Overall 
Standard 


0 


1 


8 


6 


5 


20 





Item Mean Chart— Item 1 



Response Item Response 
Choice Total x Factor « Product 


1 


0 


1 




2 


0 


2 




3 


4 


3 




4 


3 


4 




5 


3 


5 





Product Item Item 

Total N Mean 
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Step 6 

Multiply the Item Totals by the Response Factors and enter the five Products in the Pro- 
duct column. 



EXAMPLE 5. Item Totals are multiplied by the Response Factors and entered in the 
Product column. 



item Mean Chart^item 1 



Response Item Response 
Choice Total x Factor « Product 


1 


0 


1 


0 


2 


0 


2 


0 


3 


4 


3 


12 


4 


3 


4 


12 


5 


3 


5 


15 



Product Item Item 

Total N Mean 
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Step 9 



Transfer the overall Standard Response Choice Totals from the coding chart to the Stan- 
dard Total column on the standard mean chart. 



EXAMPLE 7. Standard Response Choice Totals are transferred from the coding chart 
to the Standard Total column on the standard mean chart: 

Coding Chart 



Item 


Response Choice 
1 2 3 4 5 


N 


Item 
Mean 


1 


0 


0 


4 


3 


3 


10 


3.90 


2 


0 


1 


4 


3 


2 


10 


3.60 


Overall 
Standard 


0 


1 


8 


6 


5 


20 
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I Standard Mean Chart 



Response Standard Response 
Choice Total x Factor » Product 


1 


0 


1 




2 


1 


2 




3 


8 


3 




4 


6 


4 




5 


5 


5 





Product Standard Standard 
Total N Mean 
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Step 7 

To obtain the Item Mean, sum the five Products and divide by the Item N (from the coding 
chart). 



EXAMPLE 6. The five Products are summed and divided by the Item N to obtain the 
Item Mean. 



Item Mean Chart^ltem 1 



Response Item Response 
Choice Total x Factor « Product 


1 


0 


1 


0 


2 


0 


2 


0 


3 


4 


3 


12 


4 


3 


4 


12 


5 


3 


5 


15 



39 10 3.90 

Product Item Item 

Total N Mean 



Step 8 

The Item Means should be entered in the far right column on the appropriate coding chart 
once calculated. 

Standard Means. As with item means, standard means are calculated separately for the 
interview and questionnaire responses. In orucr to calculate each set of 21 standard means, 
you will need: (1) the coding charts reporting the standard total response choices and N 
and (2) a blank scale mean chart. The essential steps for calculating standard means are 
the same as for item means. 
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Step 10 



Multiply the Standard Totals by the Response Factors and enter the five Products in the 
Product column. 



EXAMPLE 8. Standard Totals are multiplied by the Response Factors and entered In 
the Product column: 



Standard Mean Chart 



Response Standard Response 
Choice Total x Factor « Product 


1 


0 


1 


0 


2 


1 


2 


2 


3 


8 


3 


24 


4 


6 


4 


24 


5 


5 


5 


25 



Product Standard Standard 
Total N Mean 
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Step J J 



To calculate the Standard Mean, sum the five Products and divide by the Standard N (from 
the coding chart). 



EXAMPLE 9. The five Products are summed and divided by the Standard N to obtain 
the Standard Mean. 



Scato Mean Chart 



Response Standard Response 
Choice Total x Factor « Product 


1 


0 


1 


0 


2 


1 


2 


2 


3 


8 


3 


24 


4 


6 


4 


24 


5 


5 


5 


25 



75 20 3.75 

— a 

Product Standard Scale 

Total N Mean 



Step 12 



The Standard Mean should be entered in the far right column on the appropriate coding 
chart once calculated. 



35 



Charting the Audit Item and Standard Means 



Once all of the item and standard means are calculated, they should be transcribed onto 
the District EJfectiveness Audit Summary Sheet. This form simply lists each item and stan- 
dard and then provides space to enter the interview and questionnaire means. An example 
of a partially completed summary form is provided below. A blank copy of the form is 
contained in Section IX. 



EXAMPLE 10. A partially completed District Effectiveness Audit Summary Sheet is 


presented below: 








District Effecdveness Audit Summary Sheet 






inierview 


Questionnaire 








Mean 


Setting Goais and Standards 








1. The central mission of the district is 








the DFOvision of hioh oualitv instruction 








to ail children. 


3.75 




3.60 


a . The district expects all students 








to achieve the same high stan- 








dards. (Item 1) 


3.90 




3.70 


b . District leaders frequently 








discuss the provision of high 








quality instruction. (Item 2) 


3.60 




3.50 


2. The school district has defined a set of 








educational goals based on the district 








mission statement that are specific 








enough to pennit assessment of progress. 


4.57 




4.63 


a. The district has defined 








measurable student outcomes 








related to its goals. (Item 3) 


4.90 




4.85 


b . The district has specific stu- 








dent promotion standards and 








requirements. (Item 4) 


4.80 




4.85 


c . The district goals have been 








used to set individual school 








goals. (Item 5) 


4.00 




4.20 



This form will be especially useful in reviewing the audit results and preparing ihe report. 
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In addition to transcribing the interview and questionnaire means to the summary sheet, 
two bar graphs should be prepared for each of the seven audit areas. The bar graphs visually 
present for each area the number of standards that were met (i.e., standard mean is equal 
to or greater than 4.00), the number of standards that were not met (i.e., standard mean 
is equal to or less than 2.(X)), and the number of standards in which the district matched 
conventional practice (i.e., standard mean ranges from 2.01 to 3.99). Bar graphs should 
be prepared for the interview and questionnaire responses separately. 

Bar Graphs. In order to prepare the seven sets of bar graphs, you will need the com- 
pleted District Effectiveness Audit Summary Shset and 14 blank bar graphs. (Section IX 
contains two blank bar graphs which may be photocopied.) 



Step 13 

From the District Effectiveness Audit Summary Sheets determine the number of inter- 
view and questionnaire standard means for each area that were: 

• equal to or greater than 4.00 

• ranged from 2.01 to 3.99 

• equal to or less than 2.00 



Example 11. Using the iummary sheet from Example 10, the number of interview and 
questionnaire standard means that meet the three criteria are as follows: 



Cri^'^'ia Interview Questlonnalia 

Equal to or greater than 4.00 1 i 

Ranged from 2.01 to 3.99 1 i 

Equal to or less than 2.00 0 Q 
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Step 14 



Complete two bar graphs for each of the seven audit areas, marking the number of inter- 
view and questionnaire standard means that meet each of the three criteria. You will have 
to make seven photocopies of the blank bar graphs in Section IX. 



EXAMPLE 12. 


Bar graohs are prepared for the Setting Goals and Standards audit data 
presented in Examples 10 and 11. 

Setting Goals and Standards— Two Standards 


Interview Responses Questionnaire Responses 


Standards 


Standards 




4 


4 




3 


3 




2 


2 




1 








Standaids Convtntlonai Stand«rdt 
Met Prvnice Not Mtt 


Standards Conventional ^anoardt 
Mat Practict Not Mat 



You have now completed all of the necessary aggregation and analysis steps and are 
ready to move onto interpreting the audit data and preparing the report. 



Interpreting the Audit Results 

In order to make sense of the audit data, it is best to examine the two sets of statistics 
from several perspectives. The following questions may help to organize your examina- 
tion. You will want to refer to the coding charts, the District Effectiveness Audit Sum- 
mary Sheet, and bar graphs in answering these questions. 

^ How similar are the interview and questionnaire standard means? 

In order to answer this question, refer to the District Effectiveness Audit Summary 
Sheet. Item or standard means that are more than one point apart are most likely significant- 
ly different.' Item and standard means should be somewhat similar. If not, you may want 
to recheck the scoring of the two forms to be sure no mistakes were made or ask some 
of the respondents to confirm or disconfirm your findings. If significant differences per- 
sist, this may point to important areas of disagreement and/or conflict among groups within 
the district or to poor communications and misunderstandings among groups. 



* A good rule of thumb for determining the significance of differences between means is to use u one standard 
deviation difference. In the pilot sites, the standard deviations generally fluctuated around one point 
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• How well did the district perform on the 21 sets of standards? 

The District Effectiveness Audit Summary Sheet and bar graphs will help you address 
this question. On both the audit interview and questionnaire, a score of **5" is interpreted 
as best practice, ''S" reflects conventional practice, and is indicative of poor prac- 
tice. Thus, mean scores closer to "5" indicate effective performance by the district while 
mean scores closer to 'T' suggest improvement is needed. Districts should strive to score 
between "4** and ''5'\ 

• Do the item mesns within each standard point to particular strengths or 
weaknesses of the district in terms of the individual standard or audit area? 

Again, the District Effectiveness Audit Summary Sheet will be most useful. In some 
cases, the district's performance on the individual items (or indicators) making up a par- 
ticular standard may not be consistent. Individual item means should thus be examined 
to identify particular strengths or weaknesses. 

• How consistent are the individuals' responses to each interview or questionnaire 
item? 

The coding chart response patterns for each item should be examined to check for 
polarized ratings. Items with highly polarized response patterns (many low, many high 
responses) indicate significant differences in respondents' experiences or understandings 
in terms of that item. 

• Do the interview notes provide other clues to interpreting the audit results? 

Although not statistically analyzed, you should review the interviewer notes. These 
notes contain additional descriptions and examples that may provide some helpful clues 
in interpreting and understanding quantitive interview and questionnaire responses. Needless 
to say, respondents' perceptions of the district result, at least partially, from their experiences 
and interactions with others in the district. Their responses thus should be interpreted in 
light of the other findings. 



Preparing and Disseminating the Report 



After all of the data have been analyzed and interpreted, a report must be prepared sum- 
marizing the audit's findings. The report should be as brief and concise as possible. Before 
presenting the results, it is usually wise to describe events leading up to the audit, the pur- 
pose of the audit in your district, the composition of the audit team, and the procedures 
used by the audit team to collect and analyze the data. Once the stage has been set, the 
results can be presented for each of the seven audit areas. 

In preparing the report, it is important to keep the limitations of the audit process 
clearly in mind. First, the audit data represent the perceptions of individuals within the 
school system about its performance rather than verified facts. Although accurately analyzed 
and reported, these perceptions may be inconsistent with the facts in some cases. Therefore, 
a disturbingly low score on an item or a standard for a particular group or a building 
staff may represent a problem of communication or a organizational conflict rather than 
an issue of poor practice. Thus interpretation of the audit results and preparation of the 
report require careful attention to possible discrepancies between perception and reality. 

Secondly, while the standards reflect a working consensus about good pra^ice and 
are consistent with research findings, they may not fit each district perfectly. There may 
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be sound and necessary reasons in individual districts for deviations from the "best" practice 
as defined in the audit. The audit should force these arguments to be made explicit and 
to be re-examined, which is its purpose. 

And finally, the simple statistics used in the audit are merely heuristics to direct atten- 
tion to issues needing discussion or further investigation and to areas of apparent disagree- 
ment or conflict. It is important not to make too much of them, particularly of small dif- 
ferences (less than half of a point difference in item or scale means) among groups or 
school staffs. 

The results should be reported accurately and objectively. The recommended means 
of analyzing and presenting the data have been described in the previous section. The in- 
terview and questionaire results should be summarized in bar graphs that display for each 
of the seven areas of the audit the standards met or not met and the extent of conven- 
tional practice. Brief narrative summaries should accompany these charts to explain and 
amplify the results. The District Effectiveness Audit Summary Sheet should be appended 
to the report. However, the scale means for each standard should be presented in the body 
of the report along with overall judgments for each of the twenty-one standards. Item 
means from either the interviews or the survey may be presented in the body of the report 
to illustrate significant strengths (mean scores at or above 4.0) or weaknesses (mean scores 
at or below 2.0) or areas of significant difference in perception among groups (differences 
in mean scores greater than 1.0). Examples or descriptions from the interviews also may 
be used to illustrate particular points. 

The format for the report should incorporate the following sections: 

• an executive summary highlighting the findings for the seven audit areas and 
identifying areas of significant strength and areas requiring discussion; 

• a brief review of the purpose of the audit and how it was conducted (who, when, 
how, how many); 

• separate sections on the seven areas of the audit, each one including: 

- a bar graph and brief narrative that summarize the results; 

- listing of each standard in the area followed by a discussion of the results for that 
standard, including the mean scale scores tor the interviews and the questionaire and 
an Overall judgment about the district's performance against the standard. Atten- 
tion also should be given to any significant item scores and any group differences 
in perceptions. 

- identification of any other issues raised by a significant number of those interviewed. 

• several appendices presenting the District Effectiveness Audit Summary Sheet, 
any disaggregation of data by group or school building, and lists of those inter- 
viewed and members of the audit team. 

In writing the report, it is important to strive for consensus among audit team members. 
Because the report represents the team's work, the group as a whole must be able to stand 
behind it. After the report is completed, it should be presented in draft to the superinten- 
dent, board president, and other key individuals for review of its accuracy and comprehen- 
siveness. Then after any necessary revisions, it should be presented to the superintendent, 
board members, and other central office and building administrators. It is usually wise 
to stagger the distribution of the report in the order suggested above. This allows key of- 
ficials an opportunity to review and react to the report without undue constraints and 
pressure. It is also recommended that reports not be distributed in isolation; team members 
should plan to debrief the particular audience as the report is distributed. Once the 
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superintendent, board, and other administrators have reviewed and discussed the audit 
findings, the results can be released to the remainder of the district staff and public. Again, 
the audit team should schedule oral presentations to explain and interpret audit findings. 
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• VII. 

USING THE 
AGDIT RESULTS 



Technically, the av lit is complete when the report is issued, but in reality the work 
is only beginning. The real value of the audit is in the use made of its information. If 
the district has a carefully crafted, ongoing improvement planning process already in place, 
audit results ca^ He easily incorporated into the planning cycle and dealt with as a matter 
of course. In cases where procedures for planning have not been clearly established, the 
following suggestions may be helpful to a board looking for a way to approach audit results. 

• Set aside time to deal specifically with the results of the audit. Don't underestimate 
the time required. The size of the district and the magnitude of the problems 
uncovered will have a bearing on the time that will have to be devoted. A board 
retreat, properiy advertised to meet "sunshine" requirements, is one way of 
allocating time away from the usual press of business. 

• Seek recommendations from district administrators. Many of the changes the 
board is likely to want will have to come through the efforts of the administrative 
team. Thos** efforts will he stronger if the adminktrators believe in the goals 
and have helped develop implementation strategies. 

• Establish manageable goals and timelines. Not everything can or should be done 
at once. Consider other district needs as well as audit results when determining 
priorities, but don't ignore a problem just because it will take considerable time 
to resolve. Perjiaps there are small steps that can be taken to move the district 
toward the desired improvements. 

• Make sure all goals and plans are put in writing and that everyone knows what 
is expected of them. Where appropriate, incorporate the goals into the criteria 
by which the board evaluates its own effectiveness and the performance of its 
chief school administrator. 

• Establish Sv^hedules for > .ogress reviews. These may be yearly for long-term goals 
and quarteriy or even monthly ^or shorter term plans. Once established, stick 
to the schedules. If the board demonstrates that the goals are important by 
monitoring their progress, they are more likely to be achieved. 



• 
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Planning is a continuous cycle of identifying needs, establishing goals, setting priorities, 
generating alternative strategies, developing plans, implementing plans, monitoring pro- 
gress, and evaluating results. The District Effectiveness Audit is a tool for identifying cer- 
tain kinds of needs. It is up to the board and administrative team to turn needs into 
accomplishments. 
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VIII. 
AUDIT 

INSTRGMENTS 



This section contains the audit interview guide and the audit questionnaire. They have 
been printed single-sided for ease in photocopying. 

These materials may be copied for use by a school district in conducting an audit of 
its operations. They may not be reproduced for any other purpose. 
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DISTRICT EFFECTIVENESS AUDIT INTERVIEW GUIDE '"^ 



00 

2 Dire ctions: This Interview Is part of a cciiijirehenslve assessment ^^f the district's educational programs and operations. The 
^ purpose of the Interview Is to gather your perceptions of the district. There are no right or wrong answers, 

c. Instead, your perceptions, based on your experiences In this district, are most Important. It Is therefore critical 

^ that you answer the Interview questions as carefully and candidly as possible. Your responses will be kept 

confidential and reported only In aggregate form. 

0 I will read each question exactly as It Is written. I will be referring to district leaders In some of tlie 

^ questions. District leaders refer to both board members and central office administrative team (superintendent, 

g assistant superintendent, etc.). The questions are designed to ex^.m1ne the district as a whole. In rosponding, you 

g- should try to generalize about the educational programs and operations of the district overall. I will -ecord your 

> answers as carefully and clearly as possible. If I do not understand your response, I will ask ycu to elaborate. 
8 

o 
5' 

o 

3 



Do you have questions? If not, we will oegin. 
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SETTING GOALS AND STANDARDS 
!• Does the district hold the sacie high academic standards for all its students? 
1 2 3 



C/) 
n 

3- 
O 

o 

CD 
O 

01 



The district has no 
clear acrdemic 
standards. 



Notes: 



The district has low 
expectations of all 
its students. 



The district expects 
some students to achieve 
more than others, but 
standards are generally 
low. 



The district expects 
some students to 
achieve more than 
others, but standards 
are generally high. 



The district expects 
all its students to 
achieve the same high 
standards. 



O 
n 
S' 

o 

3 



2. How often does the board discuss issues concerning the quality of instruction? 
1 2 3 



The board rarely 
discusses these issues* 



The board discusses 
these issues only on 
occasions required by 
state regulations. 



The board discusses 
quality of instruction 
issues in response 
to particular problems 
or complaints. 



Quality of instruction 
issues are regularly 
discussed t most 
meetings. 



The board discusses 
quality of instruction 
issues at every meeting. 



Notes: 
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3* Are district goals specific enough to measure progress toward their achievement? 



1-3 



1 



Measurable student 
outcomes have not been 
defined. 



Measurable student 
outcomes have been 
defined for basic 
skills at some grade 
levels. 



Measurable student 
outcomes have been 
defined for basic 
skills goals at all 
grade levels. 



Measurable student 
outcomes have been 
defined for basic 
skills and some other 
academic areas. 



Measurable student 
outcomes have been defined 
for all district goals. 



Notes: 



4. Have the district's goals been used to set Individual school goals? 
1 2 3 



The district's goals 
are Ignored when 
school goals are 
determined. 



Notes: 



The district's goals 
are occasionally used 
In setting school goals. 



The district's basic 
skills goals have been 
Incorporated Into 
Individual school goals. 



The district's basic 
skills goals and a few 
others are reflected 
In the goals of 
Individual schools. 



All the district's goals 
are reflected, as 
appropriate, In the goals 
of Individual schools. 
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5, To what extent are district standards or requirements for student promotion consistently enforced? 



1 2 3 4 5 



The district has no 
specific promotion 
standards or require 
ments. 



The district has estab- 
lished requirements, 
but they have little 
influence on practice 
and are not well 
understood. 



The district has estab- 
lished requirements, 
but they are not 
implemented in all 
schools. 



The district has estab- 
lished requirements 
and they are generally 
followed throughout 
the district. Excep- 
tions are not uncoinmon. 



District requirements 
are consistently 
followed throughout 
the district. 



Notes: 



r* 
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MANAGING CURRICULUM AND PROGRAM 
6, To what extent do specific district curriculum guidelines define classroom Instruction? 
12 3 4 



o 

3" 
O 

o 



Q. 

(A 
> 

5' 
o 

3 



Written curriculum 
guidelines do not 
exist. 



Written curriculum 
guidelines exist In 
some areas, but are 
rarely consulted. 



Notes: 



There are guidelines 
for most curriculum 
areas, but there Is 
great variation In 
their use throughout 
the district. 



District curriculum 
guidelines exist In 
most areas and 
Influence classroom 
Instruction In those 
areas. 



District-wide guidelines 
set the parameters for 
all Instructional activ- 
ities. 



7, How much flexibility do teachers have In Implementing the curriculum guides (I.e.. to meet unique student needs or to take 
advantage of unique staff skills and expertise)? 

1 2 3 4 i; 



There Is little 
flexibility In the 
curriculum guides. 



There Is great variance 
across disciplines In 
the flexiblllt' of 
district curriculum 
guides. 



Some flexibility exists 
In all district curri- 
culum guides, but not 
enough to meet students' 
needs or take advantage 
of staffs' skills or 
expertise. 



Sufficient flexibility 
exists In the guides 
to meet the needs of 
some students and to 
take advantage of tiie 
skills of some staff. 



Curriculum guides provide 
sufficient flexibility to 
meet all students' needs 
and take advantage of all 
staffs' skills or 
expertise. 



Notes: 



o 



o 
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Do district policies ensure that student grouping for Instruction meets the needs of all students? 



1-6 



1 



There are no district 
policies regarding 
student grouping. 



Notes: 



Student asslnnments 
are made In thf. primary 
g^-ades on the basis of 
basic skills tests and 
rarely change for the 
remainder of their 
school years. 



StuJ'^nts ar^ grouped 
for Instruction In all 
subject areas according 
to their basic skills 
performance • Assi gnments 
occasionally' change at 
the end of the school 
year. 



Students are grouped 
for Instruction In each 
.ubject area ba;«ed on 
their academic needs. 
Assignments are changed 
as appropriate by the 
teaching staff. 



..iidents are grouped 
for Instruction In each 
subject area based on 
their aca( emiC and 
social needs. Assignments 
are not fixed and can be 
changed any time. 



Does the district provide appropriate assistance to stuaents not meeting district academic stc»:idards? 



1 



There Is no attention 
to this Issue. 



Attention Is directed 
to this Issue In 
response to grievances 
or complaints. 



The district relies on 
teaching staff to 
ensure assistance Is 
provided. 



The district requires 
annual Identification 
of such students 



The district requires 
such students be 
Identified and actively 
tracks their progress. 



Notes: 
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10. Does the district ensure that appropriate assistance is provided to students not meeting district behavioral standards? 



1 



There is no attention 
to this issue. 



Attention is directed 
to this issue in 
response to grievances 
or complaints. 



The district relies on 
teaching staff to 
ensure assistance is 
provided. 



The district requires 
annual identification 
of such students. 



The district requires 
such students be identi- 
fied and actively tracks 
their progress. 



Notes: 



11. How well followed by the board and district staff is the process for adopting curriculum? 
12 3 4 



There is no specific 
district process for 
adopting curriculum. 



A district process for 
adopting curriculum 
exists, but it is 
largely pro forma and 
has no impact on 
decisions. 



A clearly defined dis- 
trict process exists, 
but its use varies 
greatly across disci- 
plines and schools. 



A clearly defined 
district process exists 
and it is generally 
followed. 



The district process 
for adopting curriculum 
is clearly defined, 
consistently followed, 
and its use is monitored. 



Notes: 



12, How well followed by the board and district staff is the process for selecting textbooks? 
12 3 4 



There Is no specific 
district process for 
selecting textbooks. 



Notes: 



Curriculum and instruc- 
tion are not coordinated 
across grade levels and 
schools. 



A district process for 
sel jcting textbooks 
ex sts, but It is 
la '•gely pro forma and 
hai no impact on 
on dfcC^t^c"*:. 



Curriculum and instruc- 
tion are coordinated 
for basic skills areas 
within schools. There 
is little formal align- 
ment across schools. 



A clearly defined 
district process exists, 
but its use varies 
greatly across disci- 
plines and schools. 



Curriculum and instruc- 
tion are aligned in 
most areas within 
schools. There is 
little formal alignment 
across the district. 



A clearly defined 
district process exists 
and it is generally 
followed. 



Curriculum and instruc- 
tion are al igned in 
most areas within 
schools. Only basic 
skills areas are aligned 
across the district. 



The district process 
for selecting textbooks 
*z clearly defined, 
consistently followed, 
and its use is monitored. 



b 

Curriculum and instruc- 
tion are aligned in all 
areas across grade levels 
and schools. 



K. How closely are curriculum and instruction coordinated across grade levels and among schools? 
12 3 4 



Notes: 
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14, How effectively does the district ensure that special needs programs (e.g., handJcapped, bilingual, compensatory) are 
coordinated with the regular curriculum? 



i-9 



1 



There is little, if 
aoy, coordination 
between regular and 
special needs programs. 



There is some conrounica- 
tion between regular and 
special needs staff. 
Coordination and align* 
roent between the two 
depend upon teacher 
willingness to cooperate. 



Communications between 
regular and special 
needs staff occurs 
regularly. Coordination 
and alignment between 
the two depend on 
students and staff 
invol ved. 



Comrounication between 
regular and special 
needs staff occurs 
regul arly . Coordi nati on 
is monitored by super- 
visory staff, but it 
1$ uneven. 



Communication between 
regular and special 
needs staff is ongoing 
and is monitored. A high 
level of coordination 
exists between the two for 
most students and staff. 



Notes: 



o 



15. How much time are central office staff expected to spend inonltoring and improving curriculuni and instruction? 

12 3 4 5 

0% Less than 10* 11.25^t 26-49* 50% or more 

Notes: 
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16. Now much time are principals expected to spend monitoring and Improving curriculum and Instruction? 
12 3 4 
0% Less than 10% 11-25% 26-49% 

Notes: 



MO 



50% or im'Jre 



17. Does the district attempt to minimize Instructional Interruptions? 
1 2 3 



There Is no attention 
paid to minimizing 
Interruptions during 
school da^ by 
either the central 
office or the schools. 



Some schools have taken 
steps to minimize Inter- 
ruptions. There Is no 
district level emphasis 
on doing so. 



There Is an Informal 
district policy, but 
compliance varies by 
school . 



There Is a formal 
d1str1ct*w1de policy. 
Most schools adhere to 
It. 



The district places heavy 
emphasis on minimizing 
Interruptions and all 
schools follow suit. 



Notes: 
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18, How does the district encourage staff to work with students outside of the school day in curriculum-related activities? 



Ml 



1 



The district does not 
support staff/student 
activities linked to 
the curriculum outside 
the school day. 



The district encourages 
staff to participate 
in these activities, 
but provides no 
Incentives. 



The district supports 
staff participation. 
Monetary Incentives 
are provided. 



The district supports 
staff participation. 
Monetary Incentives and 
release time are 
provided. 



The district encourages 
and recognizes staff 
participation. Monetary 
Incentives, release time 
and recognition are 
provided. 



Notes: 
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ASSURING QUALITY 

19. Does the district require frequent teacher assessment of student progress? 

12 3 4 



No district require- 
ments exist. 



Notes: 



The district requests 
frequent teacher assess- 
ment. There are no clear 
guidelines or procedures. 



The district expects 
frequent teacher assess- 
ment. Procedures are 
determined by each 
school . 



District guidelin'-^ 
exist. Enforcement 
is different across 
schools. 



District guidelines 

art enforced consistently 

across the district. 



20. In what areas is student academic performance assessed distrJct-wide? 
1 2 3 



Student academic 
achievement is not 
assessed annually 
district-wide. 



Student basic skills 
achievement is assessed 
annually in some grades. 
Other areas are assessed 
irregularly. 



Student basic skills 
achievement is assessed 
annually in all grades. 
Other areas are assessed 
irregularly. 



Student performance 
in al 1 academic areas 
is annually assessed 
at some* but not all • 
grade levels. 



District-wide assess- 
ment of student performance 
in all areas and at all 
grade levels is conducted 
annually. 



Notes: 
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21. Now aligned with the district's curriculum are tests used to assess student progress? 



1-13 



1 

Tosts are not aligned 
with curriculum. 



There Is some overlap 
between the basic skills 
curriculum and district- 
wide tests. 



Notes: 



There Is a match between 
the basic skills curri- 
culum and u«str1ct-w1de 
tests. Other academic 
skills areas are not 
tested or not aligned. 



District-wide tests 01st let-wide tests 

are alleged In most are well-aligned with the 

areas with the district's district's curriculum, 
curriculum. 



S' 



22. Are school staff provided with school test results In a timely and usable manner? 



1 



School test results 
are not shared with 
school staff. 



School test results 
are shared with st:ff 
at inappropriate timea 
or In formats that pro- 
hibit analysis and 
discussion. 



School test results 
are provided to school 
staff In a timely and 
and usable manner. 
There Is no formal 
review or discussion of 
the results. 



School test results 
are provided to school 
staff In a timely and 
usable manner. The 
degree of review or 
discussion about them 
varies from school to 
:chool . 



School test results 
are provided to school 
staff In a timely and 
usable manner and are 
reviewed and discussed 
by staff. 



Notes: 
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23. How often do thorough curriculum reviews, occur? 
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1 

There are no formal 
curriculum reviews. 



Curriculum reviews occur 
when required by an 
external agency or 
Internal pressure and 
are of uneven quality. 



Curriculum reviews occur Curriculum reviews are 

on a regular i^^le, but conducted as needed but, 

are uneven In quality and when done, are thorough, 
often superficial . 



Notes: 



24. Does the district monitor curriculum Implementation? 

- 1 2 3 



The district does not 
have procedures to 
monitor classroom 
curriculum Implementa* 
tlon. 



The district has proce- 
dures, t„t they are 
either superficial or 
rarely used. 



The district has proce- 
dures, but does not 
monitor their use. 



District procedures 
exist, but monitoring 
of their use varies 
from school U school. 



Curriculum reviews occur 
on a regular cycle and a«^e 
carefully done. 



The district's proce- 
dures are consistently 
used. 



Notes: 
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25. Are there specific criteria for the evaluation of teaching staff? 
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No criteria exist. 



Notes: 



Criteria used to evaluate 
performance vary from 
school to school. 



District criteria exist, 
but they are vague and 
inconsistently used. 



Clear district criteria 
exist. Their use varies. 



District criteria are 
clearly definid and consis- 
tently used. 



26. Are supervisors expected to provide feedback and assistance to teaching staff? 



1 



Little or no feedback 
or assistance is 
provided. 



The provision of feed- 
back and assistance is 
left to the discretion 
of supervisors. 



Feedback and assistance 
is expected by the 
district, but the amount 
provided varies from 
supervisor to supervisor. 



The district has guide- 
lines that are generally 
followed. 



There is a district-wide 
program for ensuring 
assistance is provided. 



Notes: 
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ALLOCATING RESOURCES 

27. Are sufficient funds available to meet all district goals? 

12 3 4 

No program Is suffi- Some mandated programs All mandated programs Academic programs are 

clently funded. are adequately funded; are adequately funded; adequately funded; 

most programs are not. others are not. others are not. 
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All programs are adequately 
funded. 



28. What percent of the budget Is spent on Instruction? 

1 2 3 

Less than 45% 45-54% -5-bU% 

Notes: 



4 

61 -69% 



70% or above 



0^ 
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29, Is the distribution of resources across the district perceived as fair? 



1 2 3 4 b 

There are long-standing Issues of Inequity While the distribution Most see the distribution All see the distribution 

Inequities In the dis- periodically arise. Is generally seen as as fair. A few are fair and appropriate, 

tributlon of resources. fair, most people believe unhappy with It. 

special Interest groups 

claim a greater share 

of resources. 

Notes: 



30. Does the district budget allocate adequate resources to conduct coordinated curriculum development on a regular basis? 



1 

There is no allocation 
fc curriculum develop- 
ment. 



The resources allocated 
are adequate to meet 
only the most pres^^ing 
needs. 



The resources provided 
a.-e adequate, but there 
is no coordination of 
curriculum development. 



The resources provided 
are adequate. There is 
district coordination 
in priority areas. 



There are adequate 
resources allocated and 
there is coordi'^ation in 
all area.; of cu.^rlculum 
development. 



Notes: 
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31, Does the district budget allocate resources to conduct staff development on a regular schedule? 
12 3 4 
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There is no budget for 
staff development. 



Resources are provided 
as needed for special 
pi^ograms. 



Resources are provided 
for periodic events. 
Thsre is not a regular 
oudget line for staff 
development. 



Resources are provided 
regularly for district- 
ride initiatives. There 
are few resources for 
school -based programs. 



Resources are provided 
^or ongoing programs at the 
^ trict and school levels. 
These programs are linked 
to district/school improve- 
ment efforts. 



Notes: 
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32, Are personnel openings publicized to provide an equal opportunity for all qualified candidates to apply? 

12 3 4 5 



All personnel openings 
are posted in a central 
location. There is no 
external advertisement. 



All personnel openings 
are posted and announced 
in district flyers pro 
forma. There is no 
external advertisement. 



All personnel openings 
are posted and adver- 
tised locally. 



All personnel openings 
are posted Internally 
and advertised on a 
local and regional 
basis. 



All personnel openings 
are posted internally and 
advertised locally, region- 
ally, and sometimes 
nationally. There is 
regular contact with 
schools of education. 



Notes: 
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33. How does the district ensure that all personnel openings are filled by only the most qualified candidates? 

1 2 3 4 5 



M9 



No procedures exist 
for screening and rank- 
ing candidates. 



Procedures exist; how- 
ever, they are pro forma 
and have little impact 
on hiring decisions. 



Procedures exist but 
their use varies. 



All candidate qualifica- All candidate qualifica- 



tions are reviewed and 
candidates are ranked. 
The top rated candidates 
are not always offered 
positions first. 



tions are reviewed and 
candidates are ranked. 
The top rated candidates 
are always offered 
positions first. 



Notes: 
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34. Are principals responsible for recommending appointments to school staffs? 
1 2 3 



Principals are not 
Involved in selecting 
school staffs. 



Principals are involved 
in selecting staffs, but 
have little influence 
over decisions. 



Principals may be 
consulted before final 
staffing essigninents 
are made. Their wishes 
are sometimes considered. 



The principal 's wishes 
are generally considered. 



The principal's recommenda- 
tion is the one brought to 
the board for approval , 



Notes: 
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35, Does the district's salary scale attract and retain the highest quality teaching staff? 



I 



1 

The dist»^irt*s salaries 
are very low, and so 
effective staff are 
not attracted/retained. 
The district is unable 
to recruit or retain 
staff in hir,,i demand 
areas. 

Notes : 



2 

The district's salaries 
ere somewhat below 
average Effective 
instructional staff 
are sometimes lost, 
especially in high 
demand areas. 



3 

The district's salaries 
are average and some- 
what competitive in 
attrac ti ng/retai ni ng 
staff, but there is 
difficulty in high 
demand areas. 



4 

The district's salaries 
are somewhat above 
average and very 
competitive in all 
areas 



5 

The di' t's salaries 
are hig. than average 
and the district ^ually 
nas its pick of highly 
qualified staff. 



36. Does the district's scale attract and retain the highest Quality administrative staff? 



1 

The district's salaries 
are very low, so 
effecLivp staff are not 
a ttrac ted /reta i ned . 
The distr ct is unable 
to recruit or retain 
staff in high demand 
areas. 



2 

The district's salaries 
are somewhat below 
average. fective 
instructions staff are 
sometimes lost, 
especially in high 
demand areas. 



The district's salaries 
are average and some- 
what competitive in 
attracting/retaining 
staff, but there is 
difficulty in high 
demand areas. 



4 

The district's sa^aies 
are somewhat abrve 
average and very 
competitive ^n all 
areas. 



5 

The district's salaries 
are higher than average 
and the district usually 
has its pick of highly 
qualified staff. 



Notes : 



37, What Is the role of central office staff In tne supervision and development of school staff? 
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1 



Central office staff 
have no role In the 
supervision and 
development of school 
staff. 



Central office staff 
have no formal duties, 
but are sometimes asked 
to assist In specific 
supervision/development 
activities. 



Central office staff 
have some responsibil- 
ities for supervision 
and development. Their 
Involvement Is generally 
superficial . 



Central oTflce staff 
are Involved In the 
ongoing supervision 
and development of 
school staff. A; 
there are Insufficient 
resources to provide 
adequate services across 
all buildings, em^ a^^s 
Is placed on low-^ siev- 
ing schools. 



Central office staff 
are actively involved 
in the onc^oing supervision 
and development of school 
ataff in all schools. 



Notes: 



38. How much flexibility do principdls have in preparing and modifying school budgets? 



Principals have no 
flexibility in preparing 
their school budgets. 
Budgets m^ not be 
modified once set. 

Notes: 



2 

Principals have some 
flexibility in preparing 
their oudgets. Budget<; 
may not be modified 
once set. 



3 

Principals have some 
flexibility in establish- 
ing their budgets and 
m^ make some changes 
to them once set. 



4 

Principals have great 
flexibility in preparing 
their budgets, but can 
only make minor modifi- 
cations to them once set. 



6 

Principals have great 
flexibility in preparing 
and controlling their 
hjdgets. 
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39. Do principals involve staff In the development and review of school budgets? 
1 2 3 



School staffs are not 
Involved in the 
development or review 
of school budgets* 



Principals ask for 
suggestions on school 
needs. Staff are not 
otherwise Involved In 
development of school 
budgets* 



Principals sometimes Principals request staff Principals ask staff to 



distribute school 
budgets to staff for 
their review and feed- 
back. Staff have little 
Influence over final 
budgets. 



Input in preparing the 
budget. Staff dre 
consulted about budget 
lines affecting their 
areas. 



submit Uems to be included 
In the school bu'lget. 
Staff have Input in the 
development of the budget 
lines affecting their areas 
as well as the overall 
budget. 



Notes: 
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CREATING A POSITIVE WORK ENVIRONMENT 
40. Hov often do the board and the superintendent agree on mutual roles and responsibilities? 
12 3 4 



The two rarely agree 
on their mutual roles 
and responsibilities. 
They are constantly 
at odds. 

Notes : 



The two agree on some 
of their mutual roles 
and responsibilities. 
Disagreements exist in 
some critical areas. 



The two generally agree. 
Ois&jreeroents exist in 
some minor areas. 



The two generally agree. 
Disagreements sometimes 
occur in terms of 
specific situations. 



The two almost alw^s agree 
on their mutual roles and 
responsibilities. 



41. To what iK^^nt are the board and the superintendent able to resolve administ'^ative disagreements? 
12 3 4 



The board and the 
superintendent are 
constantly at odds on 
administrative issues. 
Their differences 
tend to fester over 
long periods of time. 



The board and the 
super- ntendent frequently 
disagree on administra- 
tive issues. Many con- 
flicts remain unresolved, 
but usually are put 
aside. 



The board and the 
superintendent sometimes 
disagree on administra- 
tive issues. Compro- 
mises are sometimes 
reached after some dis- 
cussion, but some con 
flicts remain unresolved. 



The board and the 
superintendent sometimes 
disagree on administra- 
tive -i^^^ues. CoraprO" 
mi es are almost always 
reached and confl icts 
are resolved. 



The board and the 
superintendent sometimes 
disagree on administra- 

issues They gener- 
ally are ablf to resolve 
their differences amiably 
in a short period of time. 



00 



Notes: 
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42. How does the board evaluate the district superintendent? 

1 2 3 



Th ^ is no formal 
syster for superin- 
tendent accountability. 



Notes: 



There is a system for 
superintendent account- 
ability, but the 
criteria are vague and 
the evaluation is 
regarded as a formality. 



There is a system for 
superintendent account- 
ability. The evaluation 
is taken seriously but 
little emphasis is 
placed on school 
effectiveness. 



43. What priority does the board give to increasing teacher-student contact, 

1 2 3 

The boarri does not ad- This issue is addressed. This issue is given 
dress ir<cre?sed teacher- but given low priority moderate priority by 
student contact. by the board. thfe board. 



Notes: 




ERIC 
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There is a system for 
superintendent account- 
ability that provides 
specific criteria for 
the evaluation of 
the superintendent's 
performance, includ- 
ing improvement in 
school effectiveness. 



There is a system for 
superintendent account- 
ability uiat provides 
for the establishment 
of annual targets, 
monitoring of the super- 
intendent's performance, 
and a full accounting to 
the board. 



.e. class size, teacher assignments, scheduling, etc.? 



This issue is given This issue is given top 

high priority by the priority by the board and 

boaro. changes in district 

practice have been uiade as 

a result. 
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44. Uo district leaders encourage, recognize and reward staff initiative and dedication to excellence? 
12 3 4 
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Staff Initiative and 
dedication are 
generally Ignored. 



Staff initiative and 
dedication are 
encouraged and recog- 
nized only at the school 
level . 



There is some district 
recognition, mostly 
in traditional w^^'S. 



Staff initiative and 
dedication are widely 
encouraged and recog- 
nized by the district 
through mostly tradi- 
tional ways. 



Staff initiative and 
dedication are widely 
encouraged, recognized 
and rewarded at the 
district levels through 
a variety of traditional 
and innovative ways. 



Notes: 
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45. Does the district encourage and recognize outstanding student performance in all areas? 
12 3 4 



Outstanding student 
performance is usually 
ignored. 



Tne district encourages 
recognition of outstand- 
ing student performance, 
but leaves the amount 
and form of recognition 
to the individual 
schools. 



The district provides 
limited recognition 
for outstanding 
student performance, 
mostly in traditional 
areas. 



The district; provides a 
great deal of recogni- 
tion in traditional 
a'^eds. 



The district provides a 
great deal of recognition 
for outstanding performance 
in all areas. 



Notes: 
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46, What is the involvement of school staffs in the development and evaluation of district goals, programs and policies? 
1 2 3-4 5 
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There is little staff 
input. 



There is superficial 
staff input through 
informal surveys or 
staff meetings. Some 
staff serve on commit- 
tees. 



There is some formal 
input through surveys or 
meetings. Some staff 
play influential roles 
on committees. 



There are standing 
committees that parti- 
cipate in the develop- 
ment or evaluation 
process. 



All staff participate in 
the development or evalua- 
tion process. 



Notes: 
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47. What opportunities are provided by district leaders for teachers to work together as professional colleagues? 
1 2 3 



Almn^it no time or 
opportuni^ is 
provided. 



Occasional inservice 
time is provided. 



Regular department and/ 
or grade level meetings 
are held in addition 
to occasional inservice 
opportunities. 



4 



There is time set aside 
each day for teachers to 
work together in addi- 
tion to formal meetings 
and inservice. 



Teachers are organized into 
teams that work together 
each day and engage in 
group planning. 



Notes: 
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48. How ciean and well -maintained are schools and offices? 
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1 



District schools and 
offices are very poorly 
maintained and ill- 
equipped (i .e., poor 
heating, lighting* 
desks, etc.) 



Notes: 



Schools and offices are 
often not clean and some 
are ill -equipped. Some 
repairs are needed. 



Schools and offices are 
generally clean and 
adequately equipped. 
They are neither a 
positive nor negative 
influence in the 
district. 



Schools and offices are 
clean, well-maintained, 
and wel 1 -equipped. They 
provide a pleasant 
physical environment. 



Schools and offices are 
clean, attractive, well- 
maintained, pleasant, and 
a source of pride to the 
community. They provide a 
highly positive physical 
environment. 



49. How adequate is work space in schools and offices? 



1 



All schools suffer 
from inadequate work 
space which liinits the 
instructional programs. 



Notes: 



Some schools and offices 
have inadequate space. 



Adequate space exists in 
most schools and 
offices. There is little 
room for new activities 
or flexible use of spAce. 



More than adequate space 
exists in schools and 
offices, permitting 
some expansion of 
activities. 



More than adequate space 
exists to meet staff and 
student needs. The space 
is flexible and permits 
variety in use and 
expansion of activities. 
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50. How safe are schools and offices for staff and students? 



09 ■ 



ft Schools and offices Some schools and offices All schools and offices 

c_ are not ser 're inter- are secure internally. are safe havens. Few 

S nally. None are secure exter- are safe externally. 
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All schools and offices 
are safe havens. Most 
are safe externally. 



District schools and 
offices are very secure. 
Safety Is not a concern 
within the district. 



MAKING IMPROVENENTS 
51. Do district leaders stress continu ous Improvement of the schools? 
1 2 3 



School Improvement Is 
seldom discussed or 
acted on by district 
leaders. 



The need for school 
Improvement is sometimes 
discussed* usually in 
response to public 
pressure or parental 
complaint. Action 
rarely occurs. 



The need for school 
Improvement is often 
discussed* but actions 
are taken only when 
conditions are extreme. 



School Improvement is 
a continuing theme 
In district plans, 
publications and 
activities. 



School irnprovement is 
constantly stressed in 
all district plans, 
publications and 
activities. 



Notes: 



52. Do district leaders perceive the district or the school as the initiator of Improvement efforts? 
12 3 4 



School Improvement 
efforts are Imposed 
from the central office. 
Individi'il school plans 
are unnecessary. 



Scbool Improvement 
efforts are Imposed 
from the central office. 
School plans are 
developed in response 
to district initiatives. 



School Improvement 
efforts are developed 
by the central office 
with school input. 
School plans are 
developed and some 
variation across schools 
is tolerated. 



School improvement 
efforts can be developed 
by schools or by the 
district. If schools 
develop the plans, they 
must be approved by 
the cent'-al office. 



School improvement 
efforts and plans are 
developed jointly by 
the central office and 
school . 



Notes: 
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53. Do district leaders provide adequate time for school improvement? 
1 2 3 
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District leaders expect 
immediate implementa- 
tion and quick results. 



Notes: 



District leaders expect 
implementation and 
results in the same 
school year. Timelines 
are sometimes ignored 
or pushed up. 



Timelines are planned 
for school improvement 
efforts, but aie some- 
times too short. 
Results are usually 
reviewed annually. 



Reasonable timelines 
are established and 
results are reviewed 
over an agreed-upon 
time period. 



Realistic timelines are 
negotiated by district 
leaders and program staff, 
and are adjusted depending 
on the effort's progress. 
Results are usually 
examined regularly over a 
pilot period. 



54. Do district leaders actively encourage and support staff to take calculated risks in school improvement efforts? 

12 3 4 5 



There are serious 
penalties for school 
improvement failures, 
regardless of extenuat- 
ing circumstances. 
Staff are not willing 
to initiate Innovative 
programs. 



Notes: 



Sometimes penalties 
exist for those involved 
with major school 
Improvement failures. 
Some staff are not 
willing to initiate 
programs. 



There can be penalties, 
if individual responsi- 
bilities were not met. 
Some staff are willing 
to try new ideas. 



There is individual 
accountability for 
schL^l improvement 
efforts, but extenuat- 
ing circumstances are 
usual ly taken into 
account. Staff are 
sometimes encouraged to 
try new ideas. 



There is collective 
accountability for school 
improvement efforts. The 
district actively 
encourages and supports 
calculated risks. Good 
faith efforts are recog- 
nized and rewarded. 
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55, In their work with schools, how often do (iistrict leaders stress current findings on effective school practices (e.g., good 

schools should concentrate on providing effective instruction appropriate to student needs in an atmosphere which is safe, 
pleasant, and conducive to learning)? 

1 2 3 d i; 
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District leaders are 
not familiar with the 
research literature. 



Notes: 



District leaders are 
familiar with research 
literature, but do not 
stress findings in their 
ongoing work with 
schools. 



District leaders are 
familiar with the 
research 1 ite^^ature 
and often refer to it 
in their work with 
school s. 



District leaders 
frequently incorporate 
research findings in 
their work wfth schools. 



District leaders 
consistently stress and 
incorporate research 
findings in their work 
with schools. 



o 



56. Do district leaders hold school staffs responsible for developing and implementing school improvement plans aimed at 
student achievement? 



improving 



1 



There are no school 
improvement plans. 



Although school improve- 
ment plans are required, 
staff are not respon- 
sible for their quality 
or implementation. 



Staff are responsible 
for school improvement 
plans. There is little 
district follow-up 
once plans are initially 
reviewed. 



Staff are responsible for Staff are responsible f^r 
school improvement plans, school improvement pi ans. 



There is some district 
follow-up to ensure 
implementation, espe- 
cially in low-achieving 
schools. 



The district consistently 
monitors implementation 
across all school s. 



Notes: 
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57. What authority do district leaders give principals to modify district I'lstructlonal policies and practices to address particular 
school deficiencies? 

1 2 3 A i; 



They may not be modi- 
fied by principals. 



They may be modified 
by principals only after 
formal and lengthy 
review by central office 
i^nd board. Principals 
hi»ve little Influence 
in this process. 



Some may be modified 
after a formal review 
is conducted by the 
central office. Princi- 
pal wishes are generally 
supported. 



They may be modified 
by principals with 
approval of the appro- 
priate district admin- 
istrator. 



They may be modified by 
principals, but full 
justification is required 
and the central office must 
be notified. 



Notes' 
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58. Do district leaders recognize the professional expertise of teachers? 
1 2 3 



District leaders have 
no confidence and are 
openly critical of the 
expertise of teachers. 

Notes : 



District leadei^s have 
confidence in a few 
selected teachers, but 
Clearly not the majority. 



District leaders' 
confidence in teachers 
varies greatly from 
school to school. 



District leaders have 
a moderate level of 
confidence in their 
teachers. 



Teachers* expertise is 
highly respected and 
sought by district 
leaders. 
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59. Do district leaders recognize the professional expertise of their administrative staff? 



1 

District leaders have 
no confidence and are 
openly critical of the 
expertise of adminis- 
trative staff. 



Notes: 



2 

District leaders have 
confidence in a few 
selected administrators, 
but clearly not the 
majority. 



3 

District leaders* con- 
fidence in administra- 
tors varies greatly 
from school to school 
and within the central 
office. 



4 

District leaders have 
a moderate level of con- 
fidence in their 
administrative staff. 



5 

Administrative staff 
expertise is highly 
respected and sought 
by district leaders. 



60. How are professional 
1 

Professiondl develop- 
ment activities are 
seldom related to 
school Improvement 
priorities directly 
or indirectly. 



Notes: 



development activities 
2 

Some professional 
development activities 
are indirectly related 
to school improvement. 
They are seldom tied 
to specific district/ 
building priorities. 



<^elated tu district/building 
3 

Most professional 
development activities 
are focused on school 
impr .vement. Some are 
tied to specific 
district/building 
priorities. 



Improvement priorities? 
4 

Mjst professional 
development activities 
are referenced to 
specific district/ 
building priorities. 



5 

All professional develop 
menc activities are 
referenced to specific 
district/building prior- 
ities. 
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61. How adequate are incentives (e.g.. recognition, release time, and money) provided by district leaders for professional 
development participation? 



1-34 



1 



There are no incentives 
for participation in 
professional develop- 
ment activities. 



Notes: 



Limited Incentives 
are provided for par- 
ticipation in profes- 
sional development 
activities. 



Traditional incentives 
are provided. They are 
generally competitive 
with those offered by 
most surrounding 
districts. 



y^riety of traditional 
and innovative incen- 
tives are provided. 
Staff are generally 
satisfied with the 
incentives offered. 



A wide range of traditional 
and innovative incentives 
are provided. The district 
and staff have some flex- 
ibility in the selection of 
incentives received. 
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WORKING WITH THE COMMUNITY 

62. In what ways does the district expect principals and teachers to be accessible and responsive to parents? 
12 3 4 



1-35 



No clear expectations 
have been set. 



The district supports 
parent-teacher/pri nclpal 
Interaction. The 
district does not mon- 
itor how frequently 
Interactions occur. 



The district encourages 
Interaction In tradi- 
tional ways (e.g., PTA, 
BacK-to-School Night). 



The district actively 
encourages Interaction. 
A variety of tradition- 
al and innovative means 
are used. 



The district actively 
plans for Interaction 
and specific mechanisms 
exist to provide for it. 
It Is Included in both 
principal and teacher 
evaluations. 



Notes: 



63. How are district-wide test results made known to the public? 
1 2 3 



District-wide test 
results are not 
reported publicly. 



District-wide test 
results are released 
and published to meet 
state regulations. 



District-wide test 
results are published 
and shared with parents. 
No Individual building 
results are released. 



All district and school 
test results are 
published and shared 
with parents. 



All district and school 
test results are published 
and "ihared with parents, 
and actively discussed In 
community forums. 



Notes: 
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64. What opportunities does the district provide for parents to become Involveri In the education of their children? 



1-36 



1 

No programs are 
encouraged or 
provided. 



Notes: 



District leaders 
encourage, but provide 
no meaningful oppor- 
tunities. 



District leaders 
encourage parent 
participation. Some 
schools have developed 
programs. No district- 
wide programs exist. 



District leaders 
encourage parent 
participation. All 
schools have developed 
their own programs. No 
district-wide programs 
exist. 



District leaders 
support both school 
and district-wide efforts 
to Involve parents. 



o 
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65. What is the Involvement of parents and community In the development and evaluation of district goals, programs, and policies? 
1 2 3 4 5 



There is little parent 
or community Input. 



There Is superficial 
parent and community 
Input. Their Input Is 
usually required by law. 



There Is some formal 
Input through meetings 
or surveys. Some 
parents or coninun1t;y 
members play influential 
roles on committees. 



There are standing 
committees that parti- 
cipate In the develop- 
ment or evaluation 
process. 



In addition to standing 
committees, district 
leaders seek parent/ 
community input and 
Involvement through a 
variety of informal 
channels. 



Notes: 
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66. How often are school facilities used by the community? 

1 2 3 



1-37 



School facilities are 
not available for 
community use. 



Notes: 



Some school facilities 
are available for 
community use during 
non-school hours, but 
seldom are used. 



School facilities are 
available for community 
use during non-school 
hours. Adult education 
and sports leagues are 
the primary users. 



School facilities are 
available for community 
use during non-school 
and school hours. 
There is regular use 
by community organiza- 
tions. 



School facilities are 
available for community 
use during non-school 
and school hours. There 
is widespread use. 



67. Does the district have a plan for soliciting and using assistance from businesses and other community organizations? 
12 3 4 5 



The district does not 
seek or encourage 
external assistance. 



The district accepts 
discrete and small 
contributions (e.g. . 
instructional materials, 
supplies, funding) from 
external agenc ies . More 
interactive assistance 
is not encouraged. 



The district accepts 
a variety of assistance 
from external agencies, 
usually dt their 
initiative. 



The district actively 
seeks assistance to 
promote its priorities. 
General guidelines have 
been developed. 



The district has a compre- 
hensive, proactive and 
well -publicized plan. 
Partnerships are actively 
sought with local organiza- 
tions to make full use of 
their resources on 
students' behalf. 



Notes: 
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DISTRICT EFFECTIVENESS AUDIT 



QUbSTIONNAIRE 



Directions; This questionnaire is a part of a comprehensive assessment 
of the district's educational programs and operations. 
The purpose of this questionnaire is to gather your 
perceptions of the district. There are no right or wrong 
answers. Instead, your perceptions, based on your 
experiences in this district, are most important. It is 
therefore critical that you complete the questionnaire as 
carefully and candidly as possible. Your responses will 
be kept confidential and reported only in aggregate fonn. 

Read each of the statements below and determine the extent 

to which it is true of your district. For each statement, 

choose the answer that best matches your opinion or 

experience, and then circle the number that corresponds to 
your answer. 



n 

0 
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To what extent do you believe that the Not To 

following is true of your school district? at some 



Q-2 



all extent Completely 



1. The district expects all students to 
achieve the same high standards. 

2. The board discusses quality of 
Instruction Issues at every meeting. 

3. Measurable student outcoaes are 
defined for all district goals. 

4. The district's goals In all areas 
are taken Into account In determining 
the goals of Individual schools. 

5. Decisions about student promotion from 
one grade to the next are guided by 
district standards. 

6. District-wide curriculum guidelines 

set the parameters for all Instructional 
activities. 

7. Curriculum guides provide sufficient 
flexibility to meet all students' needs 
and take advantage of all staffs' skills 
or expertise. 

8. Student groupings for Instruction can be 
easily changed to meet student academic 
and social needs. 

9. The district provides assistance to and 
monitors the progress of students not 
meeting district academic standards. 

10. The district provides assistance to 
and monitors the progress of students 
not meeting district behavlorlal 
standards. 

11. The district's process for adopting 
curriculum Is understood and followed. 

12. The district's process for selecting 
textbooks Is understood and followed. 
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13. Currlculun and Instruction are 
articulated across grade levels and 
aiong schools. 

14. The central office nakes certain that 
special needs programs are highly 
coordinated with tne regular curriculum. 

15. Central office staff are expected to 
spend at least half of their time 
monitoring and Improving ':urr1culum 
and Instruction. 

16. Principals are expected to spend at least 
half of their time monitoring and 
Improving curriculum and Instruction. 

17. Efforts to minimize Instructional 
Interruptions are carried out across 
the district. 

18. Monetary Incentives, release time, 
and recognition are provided to staff 
who work with students In curriculum- 
related activities outside of the 
school day. 



Not 
at 

all 



To 

some 
extent 



Q-3 



Coftipl u tel y 



2 3 4 5 



2 3 4 b 



2 3 4 b 



2 3 4b 



2 3 4 5 



19. Frequent teacher assessment of 
student progress Is required across 
the district. 

20. District-wide assessment of student 
academic progress Is conducted 
annually In all subject areas and 
at al 1 grade level s. 

21. District-wide tests are well-aligned 
with the district's curriculum. 



22. School staffs receive and discuss 
school test results which are presented 
In a timely and usable manner. 

23. Curriculum reviews occur on a regular 
cycle and are carefully done. 
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24. Procedures for monitoring curriculun 
implenentation are followed across 
the district. 

25. Procedures for evaluating teaching staff 
are defined and followed across the 
district. 



Not 
at 
al 1 



To 

some 
extent 



Q-4 



Coiiipl e tel y 



^ 3 4 J) 



2 3 4 5 



26. The provision of feedtack and assistance 
to teaching staff by supervisors is 
carried out throughout the district. 

27. All of the district's educational 
programs are adequately funded. 

28. At least 70 percent of the district's 
budget is spent on instruction. 

29. The distribution of resources across 
the district is seen by all as fair 
and appropriate. 

30. Adequate resources are provided* for 
coordinated curriculum development 
in all areas. 



31. Adequate resources are provided for 
ongoing staff development at the 
district and school levels. 

32. Personnel openings are widely publicized. 

33. Highest rarAed candidates are offered 
available positions in the district 
first. 



34. The principal's recommendations for 
school staff appointments are those 
brought to the board for approval. 

:^5. The district's salary scale allows 
it to maintain and recruit a highly 
qualified teaching staff. 
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Q-5 

Not To 
at some 

all extent Completely 



36. Th9 district's salary scale allows 
It to Maintain and recruit a highly 
qualified administrative staff. 

37. Central office staff are actively 
Involved In the ongoing supervision 
and developnent of school staff. 

38. Principals have flexibility In preparing 
and controlling their budgets. 

39. School staffs have Input In the 
development and review of their school 
budgets. 

40. The board and superintendent agree on 
their mutual roles and responsibilities. 

41. The board and superintendent are able 
to resolve differences on adnlnlstra-* 
tlve Issues In a short period of time. 

42. The board annually evaluates the 
superintendent by establishing and 
monitoring his/her performance on 
annual goal s . 

43. Increasing teacher-student contact 
time Is a high board priority that 
has resulted In some program or 
policy changes. 

44. Staff Initiative and dedication are 
encouraged, recognized and rewarded 
In a var'-sty of ways across the 
district. 

45. Outstanding student performance In all 
areas Is encouraged and recognized 
across the district. 

46. AM staff have the opportunity to 
'participate In the development and 
evaluation of district goals, programs 
and pol Ides . 
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Q-6 

Not To 
at some 

all extent Completely 



47. Teachers have opportunities each day 
to work and plan together as profes- 
sional col 1 eagues . 

48. Schools and offices are clean and 
wel 1 -Maintained. 

49. Work space In schools and offices is 
adequate and flexible enough to neet 
staff and student needs. 

50. Schools and offices are safe and 
secure for staff and students. 

51. School iHproveaent Is stressed In all 
district plans, publications and 
acti v1 ties. 

52. School laproveaent efforts and plans 
are developed Jointly by the central 
office and school staff. 

53. Realistic tinellnes for school laprove- 
■ent efforts are negotiated and set 

by district leaders and prograa staff. 

54. The district actively encourages and 
supports Initiative and calculated 
risks by staff to laprove school 
programs . 

55. District leaders stress and Incorporate 
research findings on effective school 
practices In their work with schools. 

56. School staff are held accountable by 
the district for developing and 
Inpleaentlng school Inprovenent plans. 

57. District Instructional policies and 
practices nay be modified by school 
principals to address particular 
school deficiencies with due notice 
to district staff. 
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Q-7 

Not To 
at some 

all extent Completely 



58. Teachers' professional expertise Is 
highly respected by district leaders. 

59. Adal nistrators ' prof ess 1 onal experti se 
Is highly respected by district leaders. 

60. Professional developaent activities 
are related to sperlfic district or 
building laproveaent priorities. 

61. Incentives for participation In 
prof ess 1 onal development acti v1 ties 
are available to staff and are 
effective at encouraging their 
partlclpati .. 

62. The district actively plans for and 
expects principals and teachers to 
Interact reqularly Mith parents. 

63. District and school test results are 
published and shared with parents and 
the coanunlty. 

64. Efforts to Involve parents In the 
education of their children are 
supported at both the school and 
district level. 

65. Parents and conaunlty aembers are 
actively Involved In the develop* 
■ent and evaluation of district 
goals, programs and policies. 

66. School facilities are widely used 
by the conmunlty during non-school 
and school hours. 

67. The district has a plan to actively 
solicit and use assistance from 
business and other conmunlty 
or9^n1zat1on$. 
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• IX. 

ANALYSIS AND 
REPORT FORMS 



This section contains all of the necessary blank forms to use in aggregating, analyz- 
ing, and summarizing the audit interview and questionnaire responses. The first form. 
District Effectiveness Audit Analysis Form, should be used to aggregate and analyze the 
audit interview and questionnaire responses. It contains coding charts for transferring 
responses from the individual interview or questionnaire forms, and mean charts for 
calculating item and standard means. Two sets of this form should be photocopied to aggre^ 
gate the interview and questionnaire responses. 

The second form, District Effectiveness Audit Summary Sheet, should be used to list 
the individual item and scale means for the interview and questionnaire responses. You 
will only need one copy of this form. It will be especially useful in reviewing the audit 
data and preparing the final report. 

The third and final form is the District Effectiveness Audit Bar Graph. This form 
contains two bar graphs— one for the interview responses and one for the questionnaire. 
It should be used to present the audit results graphically. You will need to make s^ven 
photocopies of this form. 
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District Effectiveness Audit Analysis Form 
Setting Goals and Standards 

1 . The central mission of the school district is the provision of high quality instruc- 
tion to all children. 



Coding Chart 
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The school district has defined a set of educational goals based on the district 
mission statement that are specific enough to permit assessment of progress. 



Coding Chart 



Item 


Response Choice 
1 2 3 4 5 


N 


Item 
Mean 
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Standard Mean Chart 



Response Standard Response 
Choice Totals x Factor = Product 


1 




1 




2 




2 




3 




3 




4 




4 




5 




5 





Product Standard Standard 
Total Total N Mean 



Managing Curriculum and Program 



1. Decisions about the curriculum, including content, sequence, time allocation^, 
and student access, are based on district goals. 

Coding Chart 
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Response Choice 
1 2 3 4 5 
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Item 
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The district has policies to ensure that curriculum and instruction are coordinated. 



Coding Chart 



Item 


Response Choice 
1 2 3 4 5 
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Item 
Mean 
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The district seeks to focus staff and student time on instruction and learning. 



Coding Chart 
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Assuring Quality 

1. The district requires regular and frequent monitoring of student progress. 
Coding Chart 



Item 


Response Choice 
1 2 3 4 5 
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Item 
Mean 
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The effectiveness of the curriculum is regularly evaluated. 



Coding Chart 
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Supervision and staff evaluation are used as methods for improvement of instruction. 



Coding Chart 



Item 


Response Choice 
1 2 3 4 5 


N 


Item 
Mean 


25 
















26 
















Overall 
Standard 

















item IMean Chart 



ResDonse Item Response 
Choice Totals x Factor = Product 


1 




1 




2 




2 




3 




3 




4 




4 




5 




5 





Product Item Item 

Total N Mean 

Standard Mean Chart 



Response Standard Response 
Choice Totals x Factor = Product 


1 




1 




2 




2 




3 




3 




4 




4 




5 




5 





Product Standard Standard 
Total Total N Mean 



Allocating Resources 



1 . Fiscal resources are sufficient to support district goals, satisfy state and federal regula- 
tions, and foster growth and improvement. 

Coding Chart 
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The district's personnel policies are used in supporting school quality. 
Coding Chart 
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District leaders allow school staffs as much discretion as possible in the allocation 
of fiscal and human resources within the framework of district priorities. 



Coding Chart 
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Creating A Positive Work Environment 



1 . The board and superintendent have agreed on the scope and direction of their mutual 
roles and responsibilities. 



Coding Chart 
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2. District policies promote success among the staff and students. 



Coding Chart 
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District policies encourage and support staff input into decision making and collegial 
relationships amop" staff. 



Coding Chart 
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The district's schools and offices are pleasant places for students and staff. 



Coding Chart 
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Making Improvements 



1. District leadership demonstrates a commitment to improvement. 
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The district has a long-range plan for improvement that defines specific targets for 
student outcomes. 

Coding Chart 
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3 , Board of education policies and regulations enhance the capacity for change and pro- 
vide for related development efforts. 



Coding Chart 
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Working with the Community 
I. The district maintains frequent and open communication with the community. 
Coding Chail 
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School facilities are available and used by the community. 
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3. The district makes effective use of external resources. 
Coding Chart 
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DISTRICT EFFECTIVENESS AUDIT SUMMARY SHEET 



Setting Goals and Standards 

1. The central mission of the 
school district is tne provision 
of high quality instruction to 
all Chi Idren, 

a. The district holds the same 
academic standards for all its 
students • (Item 1 ) 

Tne provision of high quality 
instruction in the district 
is discussed at all board 
meetings. (Item 2) 

2. The school district has defined a 
set of educational goals based 

on the district mission statement 
that are specific enough to permit 
assessment of pr)gress. 

The district has defined 
measurable student outcomes 
related to its goals. (Item 3) 

The district has specific 
student promotion standards 
and requirements. (Item 4) 

Tne district goals have been 
used to set individual school 
goal s . ( I tem 5 ) 

Managing Curriculum and Program 

1. Decisions about the curriculum, 
including content, sequence, time 
allocations, and student access, 
are based on district goals. 

a . The di s tri c t has clear 

curriculum guidelines that are 
used to define classroom 
instruction. ( I tem b ) 




a . 



Interview Questionnai re 
Mean Mean 
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Interview Ques tionnai re 
Mean Mean 



b. The curriculum guides provide 
for sufficient flexibility. 
(Item 7) 

c. District policies ensure that 
student grouping for instruction 
meets the needs of all students. 
(Item 8} 

d. Tne di:trict ensures that appro- 
priate assistance is provided to 
students >iot meeting district 
academic and benavioral standards. 
(Items 9 and 10) 



2. The district has policies to ensure 
that curriculum and Instruction are 
coordi nated. 

a. There is a clearly defined 
process for the adoption of 
curricula that is followed by 
the board .^nd district staff. 
(Item 11) 

b. There is a clearly defined 
process for the selection of 
textbooks that is folKwed by 
the board and district staff. 
(Item 12) 



c. Curriculum ana instruction are 
coordi nated across grade levels 
and school s . (I tem 1 3 ) 



d. The district has policies to 

insure that all special programs 
are coordinated with the regular 
curriculum. (I tem 1 4 ) 



3. The district seeks to focus staff and 
student time on instruction and 
learning. 

a. Central office staff are 

expected to spend a majority 
of their time monitoring and 
improving curriculum and instruc- 
tion. (Item IS) 
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Inters 'ew questionnaire 
Mean Mean 



b. Principals are expected to spend 
at least half of their time 
monitoring and improving curri- 
culum and instruction, (Item 16) 

c. The district emphasizes minimizing 
interruptions in instructional 
time. ( Item 1 7 ) 

d. The district encourages staff to 
work with students in activities 
outside the school day that are 
linked to the curriculum, 

(Item lb) 



Assuring Quality 

1. The district requires regular and 
frequent monitoring of student 
progress. 

The district requires frequent 
teacher assessment of student 
progress. (Item 19) 

District-wide assessment of 
student performance is 
conducted annually in all 
academic areas and at all 
grade level s. ( Item 2U) 

Tests used to essess progress 
are aligned with the curriculum. 
(Item 21) 

Student test results are provided 
to school staff in a timely and 
usable manner and are reviewed 
and discussed by staff. 
(Item 22) 

2. The effectiveness of the curriculum 
IS regu' irly evaluated. 

a. Thorough curriculum review, 

K-12, is conducted on a regular 
schedule. (Item 23) 





b. 



c. 
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Interview 

Mean 



Quest! onnaire 
Mean 



D. The district has implemented 
procedures to monitor curri- 
culum iir.pl eoientdw^on. (Ite^ 24) 



3- Supervision anJ stiff evaluation are 
used as methods for improvement of 
instruction. 

a. Teaching staff evaluation is 

based on specific, district-wide 
c ri teria . ^ I tem 25 ^ 



b. Supervisors are expected to 

provide feedback and assistance 
to teaching staffs. (Item 26) 



/^locating Resources 



Fiscal esource« are sufficient to 
support district goals, satisfy 
state and feoeral regulations, and 
foster growth and improvement 

a. All of tlie district's educa- 
tional programs are adequately 
funded. (Item 27) 



D. 70 percent or more of the 
district's budget is spent 
on instruction. (Item 28) 



c. District resources are 

perceived as being fairly 
distributed across the 
district. (Item 29) 



d. Resources for curriculum 

db.elopment are adequate and 
coordinated district-wide. 
( Items 30 and 31 ) 



2. The district's personnel policies 
are used to support school quality. 

a. All personnel openings are 
widely publicized. (Item 32) 



Personnel openings are filled 
only by the most qualified 
candidates. (Item 33) 
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Interview Questionnaire 
Medft Medn 



c. Principals are responsible 

for recommendl ng appol n tmen ts 
to the boar d . ( I tern 34 ) 



d. The district manages the 

salary scale to attract and 
retain the most effective 
Instructional and administra- 
tive staff. (Items 35 and Jb) 



e. Central office staff are 
actively Involved In the 
ongoing supervision and 
development of school staff. 
(Item 37) 



District leaders allow school 
staffs as much discretion as 
possible in the allocation 
of fiscal and human resources 
within the framework of district 
priorities. 

a. Principals have flexibility in 
preparing and controlling their 
school budgets. (Item 38) 



b. Principals Involve staff In the 
the develop me nt and review of 
school budgets. ( I tem 39 ) 

Creating a Positive Work Environment 



1. The board and superintendent have 
agreed on the scope and direction 
of their mutual roles and 
re spons 1 D 1 1 1 ti e s . 

a. The board and suoerintendent 
agree on their mu^ial roles 

and responsibilities. (Item 40) 

b. The board and super Intendent 
are able to resolve adminls- 
tratlve disagreements. (Item 41) 

c. The board holds the district 
superintendent accountable for 
Implementing district programs 
and pol Ides. (I tem 42 ) 
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In terview Questionnai re 

Mean Mean 

District policies promote success 

among the staff and students. 

a. In practice regarding class 

size, teacher assignments, and 
scheduling, district leaders 
give priority to teacher/ 
student contact. (Item 43) 



b. The district has procedures 
for Identifying and publicly 
recogn:'zing high pe rf ormance 
and dedi cati on by staff. 
(Item 44 ) 



c. The district has procedures 
for Identifying and publicly 
recognizing high performance 
by students . ( Item 4^) 



District policies encourage and 
support staff input 1.;to district 
decision making and colleglal 
relationships among staff. 

a. School staff participate In 
the development and evalua- 
tion of district goals, pro- 
grams, an^ policies. (Item 4t>) 



b. District leaders encourage 
communication among school 
personnel by providing time 
for staff to get together 
professionally. (Item 47) 



The district's schools and offices 
are pleasant places for students 
and staff. 

a. Schools and offices are clean 
and well -mai ntai Med. (Item 48) 



b. Schools and offices provide 
adequate work space for staff 
and students. (Item 49) 



c. Schools and offices are safe 
for both staff and students. 
(Item 50) 
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Interview Ques ti onnai re 
Mean Mean 



Making Improvements 



District leadership demonstrates 
a commitment to improvement. 

a. District leaders express the 
theme of continuous improvement 
in district plans, activities, 
and puDl icati.^ns. (Item 51) 

b. District leaders perceive the 
school as the unit of change 
and improvement. (Item 52) 

c. District leaders provide 
adequate timelines for school 
improvement. (Item 53) 

d. District leaders encourage 
staff to take calculated risks 
in school improvement efforts. 
(Item 54) 

e. District leaders stress 
research findings on effective 
school practices in their 
improvement efforts. (Item 55) 

The district has a long-range plan 
for improvement that defines 
specific targets for student 
outcomes . 

a. District leaders hold school 
staffs responsible for school 
improvement plans aimed ac 
improving student achievement. 
(Item 56) 

0. District leaders give 
pri nc i pal s authori ty to 
modify instructional policies 
and practices to address 
particular school deficiencies 
(Item 57) 

c. District leaders recognize 

the professional expertise of 
teachers and administrators. 
(Items 58 and 59) 
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mean 



3, Board of education policies and 
regulations enhance the capacity 
for change and provide for re la ted 
development programs. 

a. Professional development 
activ ties are related to 
distr ct and builcing improve-- 
nent p> iori ties, {Item 60) 

b. District leaders provide 
adequate Incentives for partici- 
cipating in professional 
development. ( Item 61 ) 

Working with the Community 

1. The district maintains frequent and 
open communication with the community. 

The district requires principals 
and teachers to be accessible and 
responsive to parents. (Item 62) 

Student test results are made 
known to the public. (Item 63) 

The district provides oppor- 
tunities for parents to become 
involved in the education of 
their children. (Item 64) 

Parents and community members 
are Involved in the development 
and evaluation of district 
goals, programs, and policies, 
( I tem 65 ) 

2. School facilities are available 
and used by the community, 

a. School facilities are widely 
used by the community during 
school and n on -school hours. 
(Item 66) 

3. The district makes effective 
use of external resources. 



a . 



b. 



c . 
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Interview Questionnaire 
Mean Mean 



The district has a plan for 
soliciting and using assistance 
from external agencies. 
(Item 67) 
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O ire: 



District Effectiveness Audit Bar Graph 



District Effectiveness Audit Area 



Number 



Standards 



Irtterview Responses 



Standards 
4 — 

3 — 

2 — 

1 — 



Standards Conventional Standards 
Met Practice Not Met 



Questionnaire Responses 
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Met Practice Not Met 
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(Affiliations as of 1984) 



Dr. Joan Abrams Superintendent, Red Bank Borough School 

District, NJ 

Dr. Julius Bernstein Former Superintendent, Livingston Township 

School District, NJ 

Ms. Stephanie Craib Principal, South Brunswick Township School 

District, NJ 

Dr. Mathew Glowski Superintendent, Alpine School District, NJ 

Dr. Joseph Kreskey Deputy Superintendent, Edison Township School 

District, NJ 

Dr. Penny Lattimer Assistant Superintendent for Curriculum & In- 

struction, New Brunswick School District, NJ 

Dr. George Libonate Assistant Superintendent, Ridgewod Village 

School District, NJ 

Dr. Marian Leibowitz Assistant Superintendent, Teaneck School District, 

NJ 

Ms. Delores McNeil Board Member, Newark School District, NJ 

Mr. Bernard Roper Assistant Superintendent/Board Secretary, Living- 

ston Township School District, NJ 

Dr. Richard Schuck Principal, Mendham Borough School District, NJ 

Dr. Jeffrey Smith Professor, Graduate School of Education, Rutgers 

University, New Brunswick, NJ 

Ms. WillaSpicer Assistant Superintendent, South Brunswick Town- 

ship School Distr t, NJ 

Dr. James Swalm Assistant Superintendent, Woodbridge Township 

School District, NJ 

Mr. Richard Willever Superintendent, West Wiiidsor-Plainsboro Regional 

School District, NJ 

Dr. Carole L. Willis Board Member, Montclair School District, NJ 
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Appendix C 
DELPHI PANELISTS 

(Affiliations as of 1984) 



Dr. Kenneth Carlson Professor, Graduate School of Education, Rutgers 

University, New Brunswick, NJ 

Mr. Rocco Carri Guidance Counselor, AtlanticCity School District, 

NJ 

Ms. Janet Fegely Teacher, Jersey City School District, NJ 

Dr. Mary Lee Fitzgerald Superintendent, Montclair School District, NJ 

Dr. Richard Gerber Board Member, Cresskill School District, NJ 

Mr. Richard Harclerode Board Member, Mercer County Special Services 

School District, NJ 

Mr. Thomas Jannarone, Jr. Superintendent, Asbury Park School District, NJ 

Mr. Ernest Kimmel Board Member, Hopewell Valley Regional School 

District, NJ 

Dr. Kenneth King Assistant Superintendent, East Orange School 

District, NJ 

Mr. David Maltman Principal, Glen Ridge School District, NJ 

Dr. Carl Mar burger Senior Associate, National Committee for Citizens 

in Education. Columbia, MD 

Or. Evelyn Ogden Assistant Superintendent, Moorestown Township 

School District, NJ 

Dr. Betty Ostroff-Carpenter Superintendent, Glen Rock School District, NJ 

Ms. Sharon Piety- Jacobs Research Associate, Center for Policy Research, 

New York City, NY 

Ms. Zita Pruitt Principal, Teaneck School District, NJ 

Mrs. Carolyn Smith Board Member, High Bridge School District, NJ 

Dr. Frank Smith Professor, Teachers College, Columbia Universi- 

ty, NY 

Dr. Jeffrey Smith Professor, Graduate School of Education, Rutgers 

University, New Brunswick, hJ 

Mr. Henry Thompson Principal, Plainfieid School District, NJ 
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Dr. Sayr Uhler Professor, Fordham University School of Educa- 

tion, NY 

Mr, Ronald G. Watson Principal, West Windsor-Plainsboro School Dis- 

trict, NJ 

Dr. Jan Weaver Dean of Professional Studies, Glassboro State 

College, NJ 

Mr. John White Officeof Legislative Services, State of New Jersey, 

Trenton, NJ 
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